DOCUMENT RESUME 



ED 326 551 



TM 015 811 



AUTHOR 
TITLE 



INSTITUTION 

SPONS AGENCY 
PUB DATE 
NOTE 

PUB TYPE 



Hecht/ Deborah; Tittle, Carol Keiir 

Mathematics Assessment Questionnaire: A Survey of 

Thoughts and Feelings for Students in Grades 7-9. 

Technical Report. Research Edition. 

City Univ. of New York, N.Y. Center for Advanced 

Study in Education. 

Ford Foundation, New York, N.Y. 

Jun 90 

169p.; For the questionnaire user's manual, see ED 
324 365. 

Reports - Research/Technical (143) — 
Tests/Evaluation Instruments (160) 



EDRS PRICE MF01/PC07 Plus Postage. 

DESCRIPTORS * Attitude Measures; Data Colloccion; Grade 7; Grade 
8; Grade 9; Junior High Schools; *Ounior High School 
Students; Mathf.-matics Tests; Pilot Projects; Problem 
Solving; ^Questionnaires; ^Student Attitudes; *Test 
Construction; Test Items; *Word Problems 
(Mathematics) 

IDENTIFIERS ^Mathematics Assessment QuestrLcnnaire 



ABSTRACT 

The Mathc'^atics Assessment Questionnaire was designed 
to sample thoughts and reelings of students in grades 7 through 9 in 
relation to solving mathematical word problems. Test development 
studies began in 1986-87 with a review of research and literature and 
the writing of sample statements that were evaluated by 16 
experienced terchers and educators. In the 1987-88 academic year, a 
series of small-scale stud.'es addressed issues related to: (1) 
metacognitive statements; (2) self-regulatory statements; (3) 
affective belief; (4) motivation; (5) attribution statements; and (6) 
usefulness to teachers. In a 1988 pilot study, the revised statements 
were administered in three forms to 1,557 students in grades 7, 8, 
and 9 in New York City. The item pool was subsequently revi^^ed to 
retain a model of the domain structure that included both st tings 
and psychological constructs. Analyses were conducted on data for 
1,368 respondents. The revised questionnaire was administered in the 
fall of 1988 to 2,658 students in grades 7, 8, and 9 in New York City 
public schools. Results from 2,451 students were examined through 
factor and discriminant analyses to provide information about 
students • item responses and test reliability. Forty tables and two 
figures provide data from the development studies. A 30-item list of 
references is included. The 161-item source questionnaire; the 
responses for the fall 1988 sample; and statemen*,: numbers, scale 
response numbers for indicators, and intevpretation of c'iagnostic 
indicators for affective belief, motivation, and attribution 
categories are appended. (SLD) 



********************************************************************* 

* Reproductions supplied by EDRS are the best that can be made 

* from the original document. 



MATHEMATICS ASSESSMENT QUESTIONNAIRE: 
A SURVEY OF THOUGHTS AND FEELINGS 
FOR STUDENTS IN GRADES 7-9 

TECHNICAL REPORT 

Deborah Hecht 
Carol Kehr Tittle 



Research Edition 



Copyright @ 1990 Carol Kehr Tittle, Deborah Hecht 
Center for Advanced Study in Education 
Graduate School and University Center 
City University of New York 
June 1990 



Nc portion of this publication may be reproduced without the 
prior written permission of the authors. 



ACKNOWLEDGEMENTS 



The mathematics coordinato*;s, principals, teachers, 
and students who assisted in the development and 
administration of the Mathematics Assessment 
Questionnaire — in Brooklyn, the Bronx, and Staten 
Island NYC Public Schools; 

The collaborative work with Professors Alice Artzt and 
Frances Curcio of Queens College, and Professors Dorothy 
Geddes and David Fuys of Brooklyn College, and Ms. Irene 
Fortunate, Ms. Terin Morales and Ms. Joyce Schwartz, 
teachers in the NYC Public Schools; 

. The research assistance of Patrick Moore, doctoral 

£*>tudent in the Ph.D. Program in Educational Psychology; 

The major support provided by the Ford Foundation, and 
their grants officer. Dr. Barbara Scott Nelson; 

The guidance provided by the members of the project 
Advisory committee — Dr. Jane Canner^ Dr. Jacquelynn 
Eccles, Dr. Elizabeth Fennema, Dr. Pascal Forgione, 
Dr. Douglas Jackson, Dr. Douglas McLeod, Dr. Sam Messick, 
Dr. John Schoener. 



UC 



1 

1 



TABLE OF C0NTSMT8 

PAGE 

ACKNOWLEDGEMENTS i 
LIST OP TABLES V 
LIST OF FIGURES 

I DESCRIPTION AND PURPOSE 

General Description of the Mathematics Assessment I- 2 
Questionnaire 

Purpose of the Mathematics Assessment Questionnaire: 4 
Teacher Planning and Classroom Use 

II RESEARCH BACKGROUND 

Research Related ro Domain Definitions II- 1 

Directed Cognition: Metacognition and i 
Self -Regulation 

Metacognition 2 
Self -Regulation 3 

Mathematics Intent ionality: Thoughts and Feelings 4 
About Learning Mathematics 

Affective Beliefs 4 
Motivations 6 
Attributions 6 

III DEVELOPMENT AND PILOT STUDIES FOR THE MATHEMATICS 
ASSESSMENT QUESTIONNAIRE: VALIDITY RELATED EVIDENCE 

Feasibility Study 1986-1987 III- 1 

Early Pilot Studies 1987-1988 1 

Metacognitive Statements 1 

Self-Regulatory Affective Belief, Motivation 8 

and Attribution Statements 

Usefulness of Sample Statements for Teachers 1 ) 



11 



5 



Spring 1988 Pilot Study 



10 



Phase 1 - Development of tae Mathematics 13 
Assessment Questionnaire - Pilot Questionnaire 

Metacognitive Statements 13 
S3lf -Regulatory, Affective Belief, Motivation 17 

and Attribution Stat .ments 
Design of the Three Foras of the Pilot 18 

Quest i onna i re 

Phase 2 - Administration, Sample Description, 20 
and Analyses of the Mathematics Assessment 
Questionnaire - Pilot Questionnaire 

Administration 20 
Sample 24 
Data Analyses 24 

Phase 3 - Revision of Item Pool and Development 29 
of the Mathematics Assessment Questionnaire 

IV EVALUATION OF THE MATHEMATICS ASSESSMENT QUESTIONNAIRE: 
RELIABILITY AND VALIDITY RELATED EVIDENCE 

Administration and Sample Description IV- 1 

Item Level Data Analyses 4 

Differential Use of Item Response Categories by Sex 4 

Metacognitive Statements - MAYBE and YES 5 
Responses 

Self-Regulatory Statements - SORT OF TRUE 6 
Responses 

Affective Belief, Motivation and Attribution 7 
Statements - SORT OF TRUE Responses 

Sex by Grade Level Comparisons - Anovas 8 

Self -Regulatory Statements 8 

Affective Belief, Motivation and Attribution 12 
Statexnents 

Comparisons of Within Grade Correlations 13 



111 



Construct Level Data Analyses 



13 



Internal Consistency Estimates 14 

Metacognitive Statements 14 

Self -Regulatory Statements 14 

Affective Belief, Motivation and Attribution 16 
Statements 

Comparisons Across Settings 18 

Comparisons by Grade Level 21 

Student Level Analyses 25 

Metacognitive Statements 25 

Factor Analysis: Four Factor Solution 25 

Factor Analysis: Two Factor Solution 28 

Fact:or Analysis of Subgroups - 30 

Sex and Achievement 

Discriminant Analyses 31 

Self -Regulatory Statements 33 

Factor analysis - During Class 33 

Factor Analysis - Working With Other Students 36 

Factor analysis - Homework 39 

Affective Beliefs, Motivations and Attributions 41 

Means and Standard Deviations 41 

Differences Across Settings 41 

Pearson Correlations 46 

Discriminant Analyses 49 

V REPORTS FOR MEAHIN6 AND USE 

Directed Cognition: Use of Statement-Level Responses V- 1 

Intentionality: Use of CRT-Type Scores 2 

REFERENCES 

APPENDIXES 

3- 1 Source Questionnaire: Classification of Statements 

4- 1 Fall 1988 Sample: Responses for grades 7, 8, and 9 for 

all MAQ Statements 

5- 1 Statement Nuiobers, Scale Response Numbers for Indicators, 

and Interpretation of Diagnostic Indicators for Affective 
Belief, Motivation and Attribution Categories 



iv 



LIST OP TABLES 



TABLE 



PAGE 



3-1 Number and Percentage of Student Responses to III- 4 

the Metacognitive Statements After Working a 
Word Problem in One of Two Formats: Al Multiple 
Choice Format (N=51) ; A2 Open Response Format 
(N=49) 

3-2 Percentage of Students Who Responded YES, MAYBE III- 6 
or NO to the Metacognitive Statements After 
Working One of Two Different Word Problems 

3-3 Percentage of Students Responding TRUE or VERY III-ll 
TRUE to Statements Varied in Level of Specificity 
for Two Psychological Constructs: Anxiety and 
Confidence 

3-4 Mathematics Assessment Questionnaire - pilot III-14 
Questionnaire Domain Specifications: Item Pool 
Facets 

3-5 Summary of Constructs Included on the Three III-19 
Forms of the Mathematics Assessment Questionnaire 
- Pilot Questionnaire 

3-5a Psychological Constructs by Activity Setting III-'^l 
Included on the Mathematics Assessment 
Questionnaire - Pilot Questionnaire, Form I - 
Part III 

3-6 Number of Common, Shared, and Unique Items on III-22 
Each of tba Three Forms of the Mathematics 
Assessment Questionnaire - Pilot Questionnaire 
and Percentage of Sample Responding to Each Form 

3-7 Number of Classes and Schools Grouped by School III-23 
Type and Location for the Pilot Study 

3-8 Sex, Grade Level and Age of Students Who III-25 
Responded to the Mathematics Assessm.ent 
Questionnaire - Pilot Questionnaire 

3-9 Coefficient Alpha Reliabilities for the III-27 
Metacognitive Items of the Mathematics Assessment 
Questionnaire - Pilot Questionnaire 

3-10 Coefficient Alpha Reliabilities for the Self- III-28 
Regulatory Items of the Mathematics Assessment 
Questionnaire - Pilot Questionnaire 



yc 



3- 11 Coefficient Alpha Reliabilities of Three Item III-30 

Clusters Mathematics Assessment Questionnaire - 
Pilot Questionnaire 

4- 1 Number of Students and Maximum Number of Missing IV- 2 

Responses for the Total Saiaple and Data Analysis 
Sample by Grade 

4-2 Grade Level, Sax and Age of Studcits Who Responded IV- 3 
to the Mathematics Assessment Questionnaire 
Total Sample and Data Analysis Sample 

4-3 Means and Standard Deviations of MAT and DRP IV- 5 

National Percentiles an.l Scaled Scores by Grade 

4-4 Mean Number of Times Boys, Girls and the Total IV- 7 

Data Analysis Sample Selected SORT OF TRUE in 
Response to Self-Regulatory Statements Within 
Activity Settings 

4-5 Mean Number of Times Boys, Girls and the Total IV- 9 

Data Analysis Sample Selected SORT OF TRUE in 
Response to the Three Items Assessing the Ten 
psychological Constructs Within the Purina Class 
Activity Setting 

4-6 Mean Number of Times Boys, Girls and the Total lV-10 
Data Analysis Sample Selected SORT OF TRUE in 
Response to the Three Items Assessing the Ten 
psychological Constructs Within the Working With 
Other Students Activity Setting 

4-7 Mean Number of Times Boys, Girls and the Total IV-11 
Data Analysis Sample Selected SORT OF TRUE in 
Response to the Three Items Assessing the Ten 
psychological Constructs Within the Homework 
Activity Setting 

4-8 Coefficient Alpha Reliabilities for the ^ IV-14 

Metacogiiitive Items as Grouped on the Mathematics 
Assessment Questionnaire 

4-9 Coefficient Alpha Reliabilities for the Self- IV-15 
Regulatory Items as Grouped on the Mathematics 
Assessment Questionnaire 

4-10 Coefficient Alpha Reliabilities for the Three IV-17 
Item Clusters of Psychological Constructs Within 
Each Activity Setting 

4-11 Coefficient Alpha Reliabilities for the Three IV-20 
Item Clusters Combined Acres'^ Activity Settings 
and Spearman-Brown (SB) Estimatec for Individual 
Settings 



VI 



^^-12 Coefficient Alpha Reliabilities by Grade for the IV-22 
Psychological Constructs Within the During Class 
Activity Setting 

4-13 Coefficient Alpha Reliabilities by Grade for the IV-?3 
Psychological Constructs Within the Working With 
Other Students Activity Setting 

4-14 Coefficient Alpha Reliabilities by Grade for the IV-24 
Psychological Constructs Within the Homework 
Activity Setting 

4-15 Factor Loadings for the Metacogritive Statements: IV-26 
Four Factor Solution 

4-16 Factor Loadings for the Meta cognitive Statements: IV-29 
Two Factor Solution 

4-17 Factor Loadings for the Self-Regulatory Statements IV-34 
in the During Class Activity Setting 

4-18 Factor Loadings for the Self -Regulatory Statements IV-37 
in the Working With Other Students Activity 
Setting 

4-19 Factor Loadings for the Self-Reguiatory Statements IV-40 
in the Homework Activity Setting 

4-20 Mean, Standard Deviation, Variance, Skewness, and lV-42 
Range of Summed Psychological Construct Scores in 
the During Class Activity Setting 

4-21 Mean, Standard Deviation, Variance, Skewnesp, and IV-43 
Range of Summed Psychological Construct Scores in 
the Working With Other Students Activity Setting 

4-22 M»».an, Standard Deviation, Variance, Skewness, and IV-44 
Range of Summed Psychological Constnict Scores in 
the Homework Activity Setting 

4-23 Means, Standard Deviations and Differences for IV-45 
the Summed Psychological Constructs as Indicateu 
by Repeated Measures Analyses Across Activity 
Settings 

4-24 Pearson Correlations Among the Summed IV-47 
Psychological Constructs and With Achievement 
Scores Within Settings 



vii 



10 



5-1 Coefficient Alpha Reliabilities of Responses to V- 5 

Three Item Clusters of Affective Beliefs, 
Motivations and Attributions Based on Summed 
Scores (Alphal) , CRT Version 1 (Alpha2) , and CRT 
Version 2 (Alpha3)' 

5-2 Dyring Class Activity Setting: Numbers of Students V- 8 
Identified as Needing Follow-up Classroom 
Activities Using Alternative Scoring Procedures 
Basod Upon Pespor- jes to at least 2 of 3 Statements 

5-3 Working With Other Students Activity Setting: V- 9 

Numbers of Students Identified as Needing Follow- 
up Classroom Activities Using Alternative Scoring 
Procedures Based Upon Responses to at least 2 of 3 
Statements 

K 

5-4 Homework Activity Setting: Numbers of Students V-10 
Identified as Needing Follow-up Classroom 
Activities Using Alternative Scoring Procedures \ 
Based Upon ^Responses to at least 2 of 3 
Statements 




r 



viii 



11 



LIST OF rXGURES 

FIGURE PAGE 

1-1 Specifications for the Ma<:hematic8 Assessment I- 3 

Questionnaire: Number of Statements for 
Psychological Constructs and Activity Settings 

3-1 specification for the Mathematics Assessment III- 16 
Questionnaire - Pilot Questionnaire 



O ix 

'£ " 12 



MAQ Technical Report 
I - 1 



CHAPTER I 

DESCRIPTION AND PURPOSE 

The Mathematics Assessment Questionnaire; A survey of 
thoughts and feelings , for students in grades 7-9, was 
developed to provide information which is complementary to 
that provided by teacher assessments or standardized tests 
of mathematical concepts and procedures. The Mathematics 
Assessment Questionnaire , MAQ, is designed to sample 
students' thoughts and feelings in relation to doing and 
learning a particular process of mathematics — solving 
mathematical word problems. The facets or dimensions used 
to design the questionnaire are: 

!• Mathematical content, 

2. Psychological construct, and 

3. Classroom related learning or activity setting. 

The first facet, the mathematical content, is the same 
in all statements — mathematical word problems. The second 
facet, the psychological construct, focuses upon students' 
thoughts and feelings. It includes metacognitive 
activities, self -regulatory activities, and affective 
beliefs, motivations and attributions. The third facet, the 
activity setting, includes three mathematics classroom- 
related situations during which students engage in problem- 
solving: during classroom instruction, while working with 
other students in a group, and while doing homework. With 
the exception of the Metacognitive statements in Part I of 
the MAQ, each MAQ statement examines a psychological 
construct related to solving or learning mathematical word 
problems within the context of one of the three activity 
settings — During Class, Working With Other Students, or 
Doing Homework. 

The Mathematics Assessment Questionnaire is concerned 
with one of the educational outcomes of schools — developing 
knowledge about mathematical concepts and procedures as 
applied in the process of solving word problems. This 
outcome is placed in the context of the thoughts and 
feelings that students have about doing mathematical word 
problems in several classroom activity settings. The MAQ 
includes statements that are related to the "mathematical 
dispositions" of students, as described in the Curriculum 
and Evaluation Standards for School Mathematics of the 
National Council of Teachers of Mathematics (1989, p. 233). 

The 'r.ay. hematics Assessment Questionnaire is based on a 
cognitive-constructivist view of the development of 
luathematicaJ 'Thinking. The emphasis is on students' direct 
reflections; on their cognitions or thinking, and their 
beliefs. The student is thus viewed as an active, 
reflective constructor of knowledge in the classroom. The 



r ( 



MAQ Technical Report 
1-2 



structure of the MAQ and the selection of statements for the 
MAQ are grounded in this view of individual learners in 
classrooms* 

General Description of the 
Mathematics Assessment Questionnairo 

The general structure and categories used in the 
Mathematics Assessment Questionnaire are shown in Figure 
1-1, including the number of statements in each category. 
The questionnaire contains 161 statements and can be 
completed by most students in grades 7, 8 and 9 within one 
40 minute class period. 

The Mathematics Assessment Questionnaire has two 
sections: 

Part I ; students solve a nonroutine word problem and 
then respond to 20 statements about what they did while 
solving the problem. These statements prompt the students 
to reflect on and indicate their awareness of their thoughts 
before, during, and after they work on the problem. For 
example, students are asked to indicate if they tried to put 
the problem in their own words before they began to solve 
the problem. Students also indicate if they are aware of 
having used any one of four problem-solving strategies. 
Response categories for the Metacognitive statements are 
YES, MAYBE and NQ. 

The 20 statements in Part I are concerned with a 
student's "directed cognition" — the self -monitoring 
processes that are thought to be important in individual 
problem-solving. Such processes are sometimes called 
metacognition, or awareness of cognitive activities during 
problem-solving (Schoenfeld, 1985) . 

Part II ; students respond to statements grouped within 
three activity settings: 

1. During Class or teacher led instruction 

(49 statements) ; 

2. Working With Qther Students in a Group 

(53 statements) ; and 

3. Doing Homework, an independent activity 

(39 statements). 

Within each activity setting there are two sets of 
statements. The first set asks students about what they do 
while they work on mathematical word problems within that 
setting. These "Self -Regulatory" statements are grouped 
like the statements in Part I: What do I do before, during 
and after — a t3acher's lesson (During Class), working in a 
group (Working With Qther Students) , or working 
independently (Doing Homework) . The statements focus on 
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Figure 1-^1 

if ications for the Mathematics Assessment Questionnaire: 
Number of Statements for Psychological Constructs 
and Activity Settings 



PSYCHOLOGI CAL COWSTRUCT 

Netacognitive: Solving a wth problea 

.before you begin, planning, 

defining objective, setting goals 

.as you work, Monitoring progress, 
keeping track 

.after you finish, evaluating, 
judging 

.strategies employed 

t»elf-regulation 

.before beginning, planning, 

defining objective, setting goals 

.during the activity, 

K)nitoring progress, keeping ti x 

.after the activity, evaluation, 
judging 

PSYCHOLOGICAL COWSTRUCT 

Affective Beliefs 

.utility, value of nath 

.interest 

.expectancies of success/confidence 
.anxiety 

Motivations 

.internal learning goals 

.external perfonwnce goals 

Attributions 

.internal stable controllable 

.internal stable uncontrollable 

.external stable uncontrollable 

•unknown control 



ACTIVITY SgTTIItG 



During Class Working With 
(Teacher- led) Other Students 


Doing 
HoMework 


20 

NETACOGNITIVE 
STATEMENTS 
LINKED TO ONE 
NON-ROUTINE PROBLEM 


6 


7 


3 


8 


8 


3 


5 


8 


3 


ACTIVITY SETTING 


During Class 
(Teadier-led) 


Working With 
Other Students 


Doing 
Hoaework 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 








3 


3 


3 


3 


3 


3 








3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 



15 



MAQ Technical Report 
1-4 



planning and goal setting (before) , monitoring progress and 
keeping track (during) , and judging, evaluating and 
reviewing (after). Students rate how true a statement is for 
thsm, on a scale from 1, VE^iY TRUE, to 5, NOT AT ALL TRUE. 

The second set of statements in aach activity setting 
asks students to reflect or* their beliefs a:ad feelings about 
mathematics word problems. These beliefs and feelings are 
related to "intentionality" or mathematical disposritions, as 
the NCTM Standards have grouped them. The constructs 
included in the Mathematics Assessment Questionnaire are: 

1. Affective beliefs (4 constructs) — the utility or 

^lue of mathematical word problems, interest in 
word problems, confidence or expectation of 
success, and anxiety or concern about doing word 
problems; 

2. Motivations (2 constructs) — internal learning goals 
and external performance goals; and 

3. Attributions (4 constructs) — beliefs about the 
causes or reasons for one's success or failure. 



I 
I 
I 
I 
I 
I 
I 
I 



Each of the ten constructs is assessed by three--itc n sets of 
statements within each of the three activity settings. As 
with the Self -Regulatory statements, students rate how true 
each statement is for them using a five point scale from 1 
VERY TRUE to 5 NOT AT ALL TRUE. 

Purpose of the Mathematics Assessment Questionnaire: 
Teacher Planning and Classrooiu Use 

The Mathematics Assessment Questionnaire was developed 
with the intention of linking assessment with instructional 
planning and decision making. Current research (see Chapter 
II) suggests that the areas of beliefs assessed in the MAQ 
are positively associated with achievement in mathematics 
and persistence in problem-solving and course taking. Other 
research suggests that student and teacher classroom 
activities and beliefs vary as a function of the subject of 
the curriculum, for example, mathematics and social studies 
(Stodolsky, 1988). 

Thus, the psychological constructs and classroom 
activity settings were selected to be relevant and useful 
for mathematics classrooms from both a research and a 
theoretical perspective. However, these are not sufficient 
grounds to suggest their usefulness in teacher planning of 
classroom instruction* The MAQ statements and methods of 
reporting students' responses were developed with the 
assistance of mathematics students, teachers, and teacher 
educators (discussed in Chapters III--IV) . The purpose of 
this developmental process was to strengthen the link 
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between the meaning teachers derive from the MAQ statements 
and teachers' instructional planning and activities based 
ipon student responses. 

The MAQ is based on the view that a teacher's role is 
concerned with understanding and supporting or facilitating 
change in students' beliefs and thinking in a specific 
context, that of mathematical problem-^solving. Embedding 
the assessment of student beliefs in the context of 
mathematics classroom activities was an attempt to directly 
link students' beliefs to teachers' thinking about 
instructional planning. 

The Matheiii acics Assessment Questionnaire is presently 
in a paper and pencil format and can be summ^irized by hand 
or by a school -developed scanning program. As an assessment 
tool, the j.nforaation from the MAQ can be used to suggest 
areas or questions for follow-up instructional activities 
with students. Possible uses for classroom planning are 
described in full in the Manual for Users (Tittle & Hecht, 
1990). As with any assessment results, the information 
needs to be used together with data about students collected 
from other sources. 
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CHAPTER ZI 

RESEARCH BACKGROUND 

The Mathematics Assessment Questionnaire is designed to 
sample students' thoughts and feelings in relation to 
engaging in and learning the process of solving mathematical 
word problems* In Part I of the MAQ these thoughts and 
feelings or awarenesses are elicited following the working 
of a nonroutine mathematical word problem. In Part II the 
thoughts and feelings are elicited in the context of 
classroom activities. With the exception of Part I, the 
Metacognitive statements, each statement includes a thought 
or feeling about mathematical word problems in the context 
of a classroom activity — During Class (direct instruction) , 
Working With Other Students (group work) , or Doing Homework 
(individual work). In this chapter the definitions of the 
constructs and related research are discussed. 

Research Related to Domain Definitions 

Directed Cognition: Metacognition and Self-Regulation 

Directed cognition is used here as a broad term which 
encompasses students' awareness of the activities and 
thinking they carry out when solving a single mathematical 
word problem (metacognition) and when participating in 
activities, such as class lessons given by the teacher, 
working with others in a group setting, or doing homework. 
In these broader activity settings, self-regulation is the 
term used to encompass student awareness of thinking and 
related activities, and performance control strategies. 

Various writers categorize these processes differently, 
but we have kept the terms metacognition and self -regulation 
distinct, in acknowledgement of the focus in mathematics 
classrooms on individual problem-solving and on broader 
activities. For the purposes of the Mathematics Assessment 
Questionnaire , Metacognition refers to a student's awareness 
of her or his cognitive activities before, during and after 
working a specific mathematical problem. Sel f -Reau 1 at ion 
refers to more general cognitive thoughts, behaviors and 
learning strategies in a specific classroom activity setting 
related to working mathematical word problems. Glaser and 
Bassok (1989) provide an overview of research in expert 
performance, developmental psychology and artificial 
intelligence problem-solving models that suggests the 
importance of these self-regulatory or control strategies in 
competent performance (pp. 641-647). They also suggest 
that, "Because knowledge of a rule or procedure is enhanced 
when one can oversee its applicability and monitor its use, 
self -regulatory skills are important outcomes of learning" 
(1989, p 641) . 
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Metacognition 

Metacognition refers to knowledge of the cognitive or 
thinking processes one uses while undertaking cognitive 
tasks such as problem-solving (Brown, 1978; Flavell, 1976; 
Garofalo & Lester, 1985) • Although researchers differ in 
exactly how they define metacognition, this term generally 
refers to the thoughts or knowledge one has about one's 
thoughts. According to Flavell (1976), metacognition 
"••.refers to one's knowledge concerning one's own cognitive 
processes and products or anything related to them..." (p. 
232). Thus, metacognition is a general awareness of 
cognitive activities engaged in during a task. Discussions 
of metacognition have typically attempted to characterize 
the cognitive activities which a person might engage in 
while working a task or a problem. Terms such as 
monitoring, checking, and reviewing are frequently used in 
relation to metacognition. 

Garofalo & Lester (1985) distinguish between two 
separate aspects of metacognition: "(a) knowledge and 
beliefs about the cognitive phenomena and (b) the regulation 
and control of cognitive actions" (p 163). Brown (1987) 
also distinguishes between metacognition which is related to 
knowledge about cognitions and metacognition which is 
related to regulation of cognition. Although the 
Mathematics Assessment Questionnaire focuses upon the second 
aspect of metacognition, the regulation of cognition, 
knowledge about the task and strategies for approaching the 
task cannot be clearly separated from regulation of the 
activity. 

Attempts to characterize the regulatory activities 
which can occur during learning or metacognition have 
resulted in several classification schemes. Garofalo & 
Lester (1985) use a framework in which problem-solving 
decisions occur in a four-step mocel. First there is 
orientation or understanding of the problem, then 
organization or planning, followed by execution of the plan 
and finally, verification or looking back and checking the 
outcomes and decisions. Brown (1987) suggests a structure 
which focuses upon planning activities prior to undertaking 
the problem, monitoring activities; during learning, and 
checking activities. 

Using a group setting as a model to observe problem- 
solving activixles, Schoenfeld (1987) has identified six 
metacognitive activities which car occur: reading, 
analyzing, exploring, planning, implementing and verifying. 
Schoenfeid's method involves asking a group of students to 
work a mathematical problem and then examining protocols of 
their activities. Schoenfeld (1985) describes competent 
problem-solvers as those who consistently monitor and 
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evaluate their solutions as they work. He uses episodes or 
stages to study the problem-solving protocols: read, 
analyze, explore, plan, implement, and verify (1985, p. 
294). He notes that these activities need not occur 
sequentially, and in fact, successful problem-solvers will 
tend to spend time moving back and forth between each 
activity* SchoeuJeld is one of the few researchers who has 
discussed metacognition in relation to the working of a 
specific mathematical problem* Instead, most discussions of 
metacognition have focused upon more general processes 
(e.g., Flavell, 1976). 

Self -Regulation 

Self-reguiation has received attention in psychological 
theories that propose descriptions of the individual's 
activities involved in learning* In social learning theory, 
Bandura (1986) proposed a cognitive view oi self -regulatory 
behavior that included subprocesses of self -observation, 
judgment, and self-reaction* Drawing on another view, Corno 
and Mandinach (1983) proposed that components of self- 
regulated learning are alertness, selectivity, connecting, 
planning, and monitoring, including self-checking* 
Meicbenbaum (1976) , in clinical studies of cognitively- 
oriented behavior modification, has also focused on 
strategies to help individuals control their own behaviors* 

Zimmerman (1989) suggested that although definitions of 
self-regulation vary greatly, three features are common to 
most definitions concerned with academic performance* 
First, the student's choice and the use of specific 
processes, strategies, and responses is purposeful, with the 
goal to improve academic achievement* Second, there is a 
self-oriented feedback loop whereby students monitor the 
effectiveness of their strategies and their responses* 
Finally, Zimmerman noted that most definitions of self- 
regulated learning include a motivational dimension which 
describes how and why the student chooses a particular 
strategy, process, or response* 

In the Mathematics Assessment Questionnaire statements 
in the Self -Regulation area are embedded in an activity 
setting* The statements are intended to elicit students' 
awarenesses of their monitoring , reviewing and evaluating 
thoughts in each setting* 

The research of Good, Grouws and Ebmeier (1983) and 
Leinhardt and Putnam (1986) provided guidance for the During 
Class Self -Regulation statements* An example of a Self- 
Regulatory statement from the MAQ in the During Class 
setting ^ — at the beginning of a mathematics lesson about 
word problems is, "I know when the teacher is beginning a 
new math idea." 
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Mathematics inteutionality: Thoughts and Feelings About 
Learning Mathematics 

Various thoughts and feelincjs have been found *"0 be 
important in learning mathematics and in persisting in doing 
mathematical problem-solving (e*g., Chipman, Brush, & 
Wilson, 1985; Eccles, Adler, Futterman, Goff, Kaczala, 
Meece, and Midgley, 1985). The general category of 
intent ionality, will, or "mathematical dispositions" is used 
in the MAQ to describe a student's affective beliefs,^ 
motivations, and attributions about learning mathematics. 
Paris (1988) has provided a persuasive argument that the 
student's understanding of the value of a skill — memory 
strategies in his example, is influential in the plans for 
and use of that skill. Others who have reviewed research 
about the interdependence of performance in mathematics and 
the learner's attitudes and feelings include McLeod (1988) 
and llcLeod and Adams (1989). 

The Mathematics Assessment Questionnaire includes ten 
psychological constructs or mathematical dispositions 
grouped into three major categories: affective beliefs, 
motivations, and attributions (see Figure 1-1, in Chapter 
I). The affective beliefs include the perceived value of a 
mathematically-related activity, interest in, confidence in. 
and anxiety or concern over doing a mathematical word 
problem. Motivations include the perceived reasons for 
approaching or learning mathematical problem-solving, 
whether these originate from the individual's own internal 
goals for learning or from external sources. Attributions 
include beliefs the student has about the causes for success 
or failure in learning or doing a mathematical word problem, 
as well as those instances in which the individual feels no 
sense of control about learning or perfoimance outcomes. 

Affective Beliefz 

Value . Value refers here to the belief that learning 
about mathematical word probJ^tns is worthwhile, useful, or 
important. The statements ubou": value are given in the 
context of one of the throe activity settings. An example 
for the During Class setting is: 

. Even when I listen to my teacher, I cannot understand 
how learning to solve word problems will help me in 
my everyday life. 

Students who respond that this statement is VERY TRUE or 
TRUE provide one indicator that they see little value or 
link between classroom experiences in mathematics and their 
outside world. 



Interests. Interests can be defined as topics or 
subjects that hold the learner's attention or arouse 
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feelings of curiosity, eagerness, liking or enjoyment. The 
negative aspects, that is disinterest, would be indicated by 
lack of curiosity, active disliking, or boredom. While not 
often assessed outside of career and occupational 
instruments, interest in mathematics and matheiuatical topics 
is a concern of teachers, hn example of an Interest 
statement in the Working With Other Students setting is: 

. I would find math interesting if I worked on a 
word problem with a group of students. 

Interests are another source of motivation in learning, 
particularly when linked to occupational requirements. 
Students are often unaware of the extensivvii use of 
mathematics in many occupations. 

Conf idence . Confidence or expectations for success can 
be defined as a belief in one's own ability to do a task or 
learn a topic. An example is the belief that one can 
successfully solve a mathematical problem. Measures of 
expectancies are related to achievement and intention to 
take additional mathematics courses (Eccles, et al., 1985). 
An example of a Confidence statement in the Doing Homework 
setting is the following: 

. I nsvor expect to be rble to do the types of 
word problems I get for homework. 

Lack of confidence may be realistic when mathematical 
skills are poor, and unrealistic when mathematical 
performance is high. Student responses to the confidence 
statements provide information that can be helpful in 
understanding student beliefs about their performance in 
solving mathematical word problems. 

Anxiety . Anxiety is defined as a state of worry, 
uneasiness or fear about one's performance on a task or area 
of endeavor. A lack of anxiety is indicated by a state of 
relaxation, a lack of concern, or a feeling of 
comfortableness while working mathematical word problems. 
Anxiety is assessed here in the context of doing or learning 
about mathematical problem-^^olving in one of the three 
activity settings. An example of a statement in the During 
Class setting is: 

. I am afraid when I have to ask my math teacher a 
question about a word problem during class. 

Anxiety is net necessarily a problem. A moderate amount of 
anxiety can be facilitating — encouraging studying for 
tests, for example. However, for students who mark the 
above statement VERY TRUE, learning may be hindered since 
the student may not be actively engaging in the classroom 
lesson. The response provides an indicator, or raises a 
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question, that can be followed up with a student. 
Motivations 

Motivation is concerned with vhe causes of goal 
oriented activity (Dweck, 1986) • According to Dweck: 

Achievement motivation involves a particular class 
of goals — those involving competence — and these goals 
appear to fall into two classes: (a) learning goals, 
in which individuals seek to increase their competence, 
to understand or master something new, and 
(b) performance goals, in which individuals seek to 
gain favorable judgment of their competence or avoid 
negative judgments of their competence. .. (Dweck, 1986, 
p. 1040). 

In general. Internal :|;iearnina Goals are intrinsic for the 
individual and emphasize learning because it is personally 
challenging and personally valued. External Performance 
Goals are extrinsically based and emphasize learning 
motivated by influences outside the individual, i.e., 
motivation based on grades or teacher approval. 

In the Mathematics Assessment Questionnaire the 
indicators of motivation are statements that assess learning 
and performance goals. An example of each type is given 
below. Students indicate how true a statement is for them 
on the scale of 1, VERY TRUE, to 5, NOT AT ALL TRUE. 

Internal Learning Goal: Working with Other Students 

Setting 

. I would work hard on a word problem with other 
students because it would help me to understand 
how to do the problems. 

External Learning Goal: Homework Setting 

. The only reason I would do extra homework problems 
is if I could get extra credit. 

Students who indicate that statements such as these are true 
for them are likely to differ in their reasons for learning. 
A long-term educational goal is to support the development 
of active mathematics learners and persistent problem- 
solvers who believe that learning is of intrinsic benefit to 
them* 

Attributions 

There are important sets of beliefs related to 
mathematics achievement and taking more mathematics courses 
that are labelled "attributions." These beliefs are also 
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related to motivation and the emotional or affective 
feelings students have toward mathematics. The particular 
attribution theory that guided the writing of the statements 
in the Mathematics Assessment Questionnaire is that of 
Weiner (1986) • 

Weiner suggests that three dimens ' ons are important in 
understanding an individual student's logic of analysis or 
beliefs about what causes the student to succeed or fail in 
tasks such as mathematical problem-solving* The perceived 
causes of failure or success can be classified according to 
a three dimensional model which includes their locus of 
control, stability, and controllability* Locus of control 
concerns whether an individual attributes success or failure 
to personal or environmental causes* The stability 
dimension refers to whether the cause is seen as changeable 
or unchangeable* The third dimension, contrcllab-.lity^ 
addresses whether or not the cause for success or failure is 
perceived to be within the individual's influence* 

Although Weiner has a set of eight categories based on 
these three dimensions, a smaller number of categories have 
been selected for use in the MAQ* In the Mathematics 
Assessment Ouestionn i/ four classifications of perceived 
causes of success or allure have been used* Examples of 
the statements within each classification are given for each 
of the categories. Again, students give their rating of how 
true the statement is for them on th^ scale 1, VERY TRUE, to 
5, NOT AT ALL TRUE. 

. Internal, Stable, Uncontrollable: During Class Setting 

If I can follo\^ my teacher's explanation for word 
problems, it is because I am smart* 

The student who agrees that this statement is VERY TRUE, may 
be indicating a set of beliefs about how and why he or she 
aciieves. The causal factor in success is perceived to be 
internal — the self. The cause is stable, something that 
does not change — smart = ability. And, the cause is 
uncontrollable, since ability is not something over which 
the student has ''.ontrol* You cannot change how smart you 
are* Contrast this set of beliefs with the next* 



§ 
I 



• Internal, Stable, Controllable: Working With Other 

Students setting 

If I cannot solve a word problem with other students, 
it is oecause we did not try as hard as we could on 
the problem. 

The student who agrees with this statep^nt may be indicating 
a set of beliefs about causes of failure as follows: the 
causal factor in failure is internal — in the student; the 
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cause is stable — hard work; an^ yet the cause is 
controllable, "we didn't try as hard as we could." Students 
who attribute success oi failure to something they can do or 
can not do, and believe it is controllable by them, have a 
set of beliefs that should facilitate learning* These 
beliefs can be contrasted with those in the third category: 

. External, Stable, Uncontrollable: Homework setting 

If I am unable to do hom<iWork word problems, it is 
because the math book is confusing. 

The student who agrees v^ith this statement may be indicating 
beliefs that the causal factor in failure is external to the 
student — the mathematics book; the cause is stable — a book; 
and the cause is uncontrollable, the student cannot change 
the mathematics textbook. Again, this is a set of causal 
beliefs about student failure that does not put the 
responsibility for the failure with the student. However, 
this student has some beliefs about why success or failure 
occurs. Contrast this statement with the next category, 
unknown control, 

. Unknown Control: During Class Setting 

I usually do not know what is going on when my 
teacher is explaining a word problem, 

Tn this fourth category of attributions there is a perceived 
confusion and inability to make sense out of causality. 
Following Connell (1985) , in Unknown Control students may be 
saying that they do not know why these learning outcomes 
occur. They indicate a lack of knowledge about tha locus or 
source of causality. Another example that students might 
use is, "If I get a bad grade in school, I usually don't 
understand why I got it" (Connell, 1985, p, 1022). 

The first three attribution or causal categories above 
were selected because they provide a contrast for students 
and teachers on two central dimensions: The internal- 
external locus of causality; and the perception of the cause 
as controllable or uncontrollable. The fourth category of 
Unknown Control provides a different construct — students who 
are confused or unclear about the relationships between 
their behaviors and perforaance outcomes for success or 
failure. 

In summery, student responses to statements in these 
four categories may be useful in understanding how students 
attribute the causes of their successes and failures in 
mathematical problem-solving, 

overall, the statements in the M athematics Assessmen t 
Questionnaire are based on specific psychological constructs 
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and are enbedded in classroon activity settings for the 
purpose of providing exiuaples of student responses that will 
assist i.i understanding the context in whic^ Vperfbr^ of 
siatheaatical problem-solving occurs. Mathenatical prbblem- 
solving occurs 1. the context of student thc**tjhi:»> feelings 
and beliefs, anJ in the social con^.ext of cla^.irboni activity 
settings. 
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CHAPTER III 

DEVELOPMENT AMD PILOT STUDIES 
FOR THE MATHEMATICS ASSESSMENT QUESTIONNAIRE: 
VALIDITY RELATED EVIDENCE 

The construction of the Mathematics Assessment 
Questionnaire is described in this Chapter. Throughout the 
development of the MAQ, there were two major concerns: the 
meaning of the statements to students and teachers, and the 
potential use of the statements for instructional planning. 
A major focus in development was on the foina in which the 
information from student responses can be most usefully 
reported to teachers and the use of the MAQ by teachers for 
instructional planning. The usefulness of various groupings 
of statements and types of reporting of responses have been 
examined in collaboration with teachers. These studies are 
also described in this Chapter. 

Feasibility Study 1986-1987 

The development studies for the Mathematics Assessment 
Questionnaire began in 1986-87. During that year, the 
feasibility of the assessment tool was examined by reviewing 
the research and literature related to mathematics and 
attitudes, cognitive processes, motivations, and related 
constructs. This work was followed by the writing of sample 
statements in the context of classroom activities. Sixteen 
experienced teachers and mathematics educators from the New 
York City area attended a one-day meeting to discuss and 
evaluate the statements for their usefulness for 
instructional planning. Their responses were generally 
positive. ThG teachers indicated that the sample statements 
would provide information about students that is important 
in learning mathematics and information that is not 
currently available in standardized tests, ^oacher ratings 
also indicated that student responses to the statements 
would provide information useful in planning instruction 
(Tittle, 1987) . 

Early Pilot Studies 1987-1988 

The next stage in development took place during the 
1987-88 academic year. During this period a series of 
small-scale studies were conducted which addresser*, a variety 
of issues related to the content, structure, and format of 
the MAQ. 

Metacognitive Statements 

Sample Metacognitive prompts or statements were written 
based upon a review of ti^e literature as well as teacher and 
student interviews. These statements were written to 
include behaviors engaged in before, during and after 
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working a specific mathematical word problem (e.g., 
planning, monitoring, evaluation, and strategies). Studies 
were conducted to explore the wording of these sample 
Metacognitive statements and the types of word problems 
which could be used with the statements. These studies were 
designed to answer three questions about the Metacognitive 
statements. 

Question 1 . Were the types of Metacognitive statements 
proposed meaningful to students? 

Question 2 . Do students understand the proposed statements? 

Study 1 ; As a first step in answering these two 
questions, four teachers and four mathematics teacher 
educators reviewed the sample Metacognitive statements for 
content, interpretability, and structure. They were 
encouraged to provide suggestions for revising the 
statements. Their comments were reviewed and some items 
were revised or eliminated. 

Study 2 ; As a second step, 20 seventh and eighth-grade 
students were interviewed, either alone or in pairs, using 
the "think aloud" procedure. While working a word problem, 
the students were asked to talk out loud. They were then 
asked to respond to the Metacognitive statements. It was 
noted when they had difficulty understanding any of the 
statements. Students were also asl'ed to explain what each 
Metacognitive statement meant to them, and were asked how 
they would say the same statement to classmates, using their 
own words. 

Study 3 ; To further explore the words which students 
use to explain word problems, students in four mathematics 
classrooms responded to the following question, presented as 
part of an in-class exercise. 

"If you were asked to teach someone how to solve the 
following problem, what steps would you tell him/her to 
follow?" 

"1/4 + 1/3 = ?" 

Student responses were reviewed. Attention was paid to 
the words students used to describe their working of the 
problem. 

Question 3 . Does it make a difference what type of word 
problem is worked before responding to the Metacorjnitive 
statements? 

Two studies were conducted during 1987-88 to compare 
stuc^ nts' responses to the sample Metacognitive prompts 
following the working of different types of word problems. 
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The participating seventh and eighth-grade students in coth 
studies were enrolled in urban, inner city schools. 

Study 1 : For the first study, alternate versions of a 
worksheet were randomly distributed within four junior high 
classes at three schools. All students worked the following 
mathematical problem: 

If I buy 4 candy bars at IS/zT each and pay for them with 
a dollar, how much change will I get? 

On one version of the worksheet students were provided with 
multiple choice options in response to the word problem: 

a) 19jz^ 

b) 40^ 

c) eOjt! 

d) 85^ 

This version resembled the format on most standardized 
mathematics achievement tests. The second version was open 
ended, requiring the student to work the problem completely. 

After students worked the word problem, with either tha 
multiple choice or open ended form, they responded to the 
sample Metacognitive statements about what they did. All 
students were provided with four response categories: 

DK - I don't know what I did 
NO - No, I didn't do this 
MAYBE - I may have done this 
YES - Yes, I did do this 

Table 3-1 presents the percentage of students in each 
group who responded to each category after working the 
problem. Students' rei'nonses to the Metacognitive 
statements differed somewhat depending upon the version of 
the worksheet (multiple choice or open ended) . 

However, regardless of the form which was administered, 
the "don't know" option was rarely selected (less than 9% of 
the time, and in most cases selected by no students) . 
Furthermore, the classroom teachers noted that the students 
often found it difficult to distinguish between the "don't 
know" and "maybe" categories. As a result, it was decided 
to delete the "don't know" category from further studies. 

When the teachers whose classes participated were asked 
about this task, they reported that the students seemed to 
understand the instructions and the wording of the items. 
Yet, both the students and teachers stated that the word 
problem worked was too easy and too routine for junior high 
school students. So!ae students remarked that they didn't 
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Tabl- 3-1 

Number and Percentage of Student Responses to the Metacognitive Statements 
After Working a Word Problem in One of Two Formats 
Al Multiple Choice Format (N=51)i A2 Open Response Format (N=A9) 

~ " Don't No Maybe Yes Missing 

Know 



Metacognitive Statements 




N % 


N 


% 


N 


% 


N 


% 


N 


% 


1 

X « 


I read the numbers and 


Al 


0 


(0) 


35 


(69) 


0 


(0) 


16 


(31) 


0 


(0) 




symbols before I read 


A2 


0 


(0) 


36 


(73) 


0 


(0) 


11 


(22) 


2 


(5) 




the words. 
























9 


I read the entire 


Al 


0 


(0) 


3 


(6) 


1 


(2) 


47 


(92) 


0 


(0) 




problem. 


A2 


0 


(0) 


1 


(2) 


0 


(0) 


48 


(98) 


0 


(0) 


3. 


I read the problem more 


Al 


0 


(0) 


18 


(35) 


7 


(14) 


26 


(51) 


0 


(0) 




than once. 


A2 


0 


(0) 


13 


(27) 


6 


(12) 


26 


(53) 


4 


(8) 


4. 


I nskad myself, Do I 


Al 


1 


(2) 


19 


(37) 


9 


(18) 


22 


(43) 


0 


(0) 




imderstand what the 


A2 


0 


(0) 


12 


(25) 


8 


(16) 


28 


(57) 


1 


(2) 




question is asking me? 
























5. 


Before starting the 


Al 


2 


(4) 


16 


(31) 


5 


(10) 


26 


(51) 


2 


(4) 




problem, T thought about A2 


2 


(4) 


19 


(38) 


5 


(10) 


22 


(45) 


1 


(2) 




a plan foi- doing it. 
























6. 


I picked out the 


Al 


0 


(0) 


3 


(6) 


1 


(2) 


46 


(90) 


1 


(2) 




operation(s) I needed 


A2 


1 


(2) 


3 


(6) 


6 


(12) 


38 


(78) 


1 


(2) 




for this problem. 
























7. 


I asked myself, Have I 


Al 


k 


(8) 


25 


(49) 


5 


(10) 


16 


(32) 


1 


(2) 




worked on a problea like A2 


1 


(2) 


26 


(53) 


7 


(14) 


14 


(29) 


1 


(2) 




this before. 
























8. 


As I worked this problem, Al 


1 


(2) 


17 


(33) 


3 


(6) 


30 


(59) 


0 


(0) 




I checked my work step- 


A2 


0 


(0) 


12 


(25) 


b 


(10) 


30 


(60) 


2 


(5) 




by-step as I went along. 
























9. 


I looked at the answer 


Al 


0 


(0) 


14 


(27) 


5 


(10) 


31 


(61) 


1 


(2) 




choices and picked the 


A2 


a 






















one that seemed right. 
























10. 


When I got my answer, I 


Al 


0 


(0) 


9 


(17) 


8 


(16) 


32 


(63) 


2 


(4) 




looked back at the prob- 


A2 


0 


(0) 


k 


(8) 


5 


(10) 


39 


(80) 


1 


(2) 




lem to make sure it made 


























sense. 

























^ Item not given on A2 form, open response format. 
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have to really think to ansv/er this problem, but that the 
(Metacognitive) statements helped them, "think about what 
they should do," A teacher noted, "The problem was too easy 
for many of the students — therefore students who would 
normally re-read a problem did not," This may be one reason 
larger differences were not found among responses to the two 
formats. 

The teachers also noted that some of the Metacognitive 
statements were not important, or at least not useful 
problem-solving approaches, given the problem which was 
worked. For example, one teacher felt that students' 
responses to the statement "I asked myself. Have I worked a 
problem like this one before?" did not provide meaningful 
information because the problem was very routine. As 
another teacher observed, "The questions would have been 
more useful if the original problem was one that required 
more thought." Therefore, it was decided to administer a 
somewhat more difficult nonroutine problem. 

Study 2 ; The second study was designed to compare 
student responses on the sample Metacognitive statements 
using two different mathematics problems. One problem was a 
nonroutine coin problem: 

Eight pennies are arranged in a row on a table. Every 
other coin is replaced with a nicke? . Then, every 
third coin is replaced with a dime. Finally, every 
fourth coin is replaced with a quarter. What is the 
total value of the coins on the table? 

The other problem was a routine change problem: 

You spent $2.t0 on cookies and three times as much on 
other food. How much change did you receive if you 
paid with a 20 dollar bill? 

Students solved one of the two problems, then responded to 
the same set of Metacognitive statements. The response 
categories for this study were: 

NO - No, I didn't do this 
MAYBE - I may have done this 
YES - Yes, I did do this 

The problems and statements were administered randomly 
within eight classrooms, so essentially equivalent groups of 
students responded to the statements following each problem. 
One hundred and five students worked the coin problem and 92 
students worked the change problem. Students were in grades 
seven and eight, and attended one of three schools. 

The data in Table 3-2 show that different questions 
elicit different awareness of cognitive activity on the part 
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Table 3-2 

Percentage of Students Who Responded YES, MAYBE or NO to the Metacognitive 
Statements After Working One of Two Different Word Problems 



Problem Al: Eight pennies are arranged in a row on a table. Every other 
coin is repla«^ed with a nickel. Then, every third coin is 
replaced with a dime. Finally, every fourth coin is replaced 
with quarter. What is the total value of the coins on the 
table? 

Problem A2: You spent $2.50 on cookies and three times as much on other 
food. How much change did you receive if you paid with a 20 
dollar bill. 



Directions: First solve the problem. Then turn the page and answer the 
statements about what you thought and did. 

BEFORE YOU BEGAN TO SOLVE THE PROBLEM - WHAT DID YOU DO? 









YES 


MAYBE 


NO 




1 « 


Ji reaa cne nujuDers ana symuois 


A1 • 


















1 8% 

X O A 


\J f m 




2. 


I read the entire problem. 


Al: 


94% 


2% 


4% 


(N=104) 






A2: 


95% 


3% 


2% 


(N= 92) 


3. 


I thought to myself. Do I 


Al: 


68% 


22% 


10% 


(N=105) 




understand what the question 


A2: 


61% 


17% 


22% 


(N= 92) 




is asking me? 












4. 


I tried to put the problem 


Al: 


45% 


25% 


30% 


(N=105) 




into my own words. 


A2: 


26% 


25% 


49% 


(N= 92) 


5. 


I read the problem more 


Al: 


86% 


8% 


6% 


(N=104) 




than once. 


A2: 


76% 


9% 


15% 


(N= 92) 


6. 


I asked myself. Do I know how 


Al: 


55% 


27% 


18% 


(N=101) 




to do this proMem? 


A2: 


44% 


18% 


38% 


(N= 90) 


7. 


I tried to re«e«ber if I had 


Al: 


36% 


15% 


49% 


(N=105) 




worked a problem like this before 


A2: 


30% 


20% 


50% 


(N= 92) 


8. 


I thought about what information 


Al: 


76% 


13% 


11% 


(N=105) 




1 needed to solve this problem. 


A2: 


70% 


20% 


10% 


(N= 92) 


9. 


I asked myself. Do I have enough 


Al: 


39% 


32% 


29% 


(N=104) 




information to solve this problem 


A2: 


41% 


18% 


41% 


(N= 91) 


10. 


1 asked myself. Is there infor- 


Al: 


22% 


23% 


55% 


(N=104) 




mation in this problem that I 


A2: 


17% 


21% 


62% 


(N= 92) 



don't need? 
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Table 3-2 (continued) 









YES 


MAYBE 


NO 




11 


T nicked out the ooerations I 
needed to do this problem. 


Al: 
A2: 


65% 
71% 


19% 
15% 


16X 
14% 


(N=104) 
(N= 92) 


12. 


I felt confused and could not 
decide what to do. 


Al: 
A2: 


28% 
16% 


33% 
16% 


39% 
68% 


(N=105) 
(N= 92) 


13. 


I drew a picture to help me 
understand the problem. 


Al: 
A2: 


48% 
6% 


9% 
11% 


43% 
83% 


(N=105) 
(N= 92) 


AS YOU WORKED THE PROBLEM - WHAT DID YOU DO? 














YES 


MAYBE 


NO 




14. 


I wrote out all the steps as 
i worKeo Lue prooiera. 


Al: 
A2: 


52% 
52% 


18% 
14% 


30% 
34% 


(N=100) 
(N= 89) 


15. 


I kept looking back at the 

prODlclU aJLLCL X. LL ILL a 


Al: 
A2: 


77% 
53% 


8% 
14% 


15% 
31% 


(N= 99) 
(N= 89) 


16. 


I had to stop and rethink a step 
I had already done. 


Al: 
A2: 


42% 
42% 


27% 
14% 


31% 
44% 


(N=100) 
(N= 89) 


17. 


I checked ray work step-by-step 
as I worked the problem. 


Al: 
A2: 


67% 
61% 


18% 
14% 


15% 
25% 


(N=100) 
(N= 88) 


18. 


I did something wrong and had 
to re-do ray step(s). 


Al: 
A2: 


40% 
23% 


20% 
17% 


40% 
60% 


(N=100) 
(N= 89) 


19. 


I looked back to see if I did 
the correct calculation. 


Al: 
A2: 


77% 
74% 


14% 
10% 


9% 
16% 


(N= 97) 
(N= 89) 


20. 


I checked to see if ray 
calculations were correct. 


Al: 
A2: 


74% 
81% 


14% 
7% 


12% 
12% 


(N= 98) 
(N= 88) 


21. 


After I did the problem I went 
back and checked it all again. 


Al: 
A2: 


48% 

50% 


27% 
21% 


25% 
29% 


(N= 98) 
(N= 87) 


22. 


I stopped before I got an answer 
to this problem. 


Al: 
A2: 


24% 
20% 


27% 
20% 


49% 
60% 


(N= 97) 
(N= 89) 


23. 


When I got my answer, I looked 
back at the problem to see if 


Al: 
A2: 


74% 
64% 


15% 
15% 


11% 
21% 


(N= 99) 
(N= 89) 



my answer made sense. 
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of students- For example, statement 4 shows that students 
who worked the coin problem reported that they tried to put 
the problem in their own words more frequently than students 
who worked the change problem. The coin problem is a 
nonroutine problem with more than one answer, whereas the 
other problem is routine and has only one answer. 

Tb results indicate the importance of providing 
students with opportunities to apply their mathematical 
skills to problems that are challenging. Furthermore, the 
problems should encourage the view that problems can have 
more than one way to work them and may have more than one 
solution. Based on this study, the nonroutine coin problem 
was selected for the Mathematics Assessment Questionnaire . 

self-Regulatory/ Affective Belief, Motivation and 
Attribution Statement? 

Existing measures of mathematics anxiety, confidence, 
value and interest typically ask students to respond to the 
general term, "mathematics" or "math." Since the 
Mathematics Assessment Questionnaire is intended to be 
useful f^r classroom instructional purposes, there was a 
concern about the specificity of the statements that might 
be needed. Studies were therefore conducted to examine the 
effect of using different mathematical content and different 
levels of specificity of the content (e.g., mathematics or 
mathematical word problems) . 

Question 1 . Do students respond differently when the 
mathematical content and level of specificity are varied? 

Two worksheets were randomly distributed within three 
seventh and eighth-grade junior high school classrooms in 
two schools. Students were presented a list of various 
mathematical topics. Approximately half the students in 
each class were presented the mathematics topics in words, 
such as read a graph, division, use a calculator, fractions, 
figure change in a store, mathematics problems, word 
problems, decimals, and mathematics puzzles. The other half 
of the students were asked the same two questions, but 
presented actual examples of mathematical problems, for 
example, 2.003 + 1.4 + 4.09. The students were then asked: 
1) how much they would like to do, and 2) now easy or hard 
it would be to do, the various mathematics topics. 

Examination of the responses to statements on each form 
suggested that both students' re, rted liking and students' 
perceptions of difficulty differ depending upon the 
mathematical content, as might be expected. That is, 
students might report liking one type of problem, but 
disliking another. Thus, the distribution of responses 
differed for the different topics or problems. 



lERLC 
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Although the same students did not complete both forms, 
the distributions were compared across the two forms for 
somewhat comparable subject matter topics. This suggested 
that the level of specificity had an impact upon students 
responses. For example, when asked 

How much would you like to do math "word problems?" 

the number and percentage of students responding were: 

N % 

like very much 9 18 

sort of like 28 56 

sort of dislike 10 20 
dislike very much 3 6 

However, when asked the same question in reference to the 
following word problem: 

One pen^'dl costs 10c and ono. pen costs 25c. If Barbara 
wants buy five pencils and four pens, how much money 
does sne need? 



the number and percentage of students responding were: 



N % 

like very much 31 62 

sort of like 15 30 

sort of dislike 4 3 

dislike very much 0 0 



The first example included a less specific mathematical 
topic (math word problems) than the second example (a 
specific word problem) . These results suggest thac 
students' reports of liking/disliking of mathematical word 
problems vary as a function of the level of specificity and 
.iiathematical content or topic in the statement to which they 
respond. 

Question 2 . Are student responses affected by using the term 
"mathematics" vs. "mathematics word problems" vs. a verbal 
description of a word problem vs. a particular word problem? 

To answer this question, statements with differing 
levels of content specificity were randomly administered to 
students within each of eight mathematics classes (grades 
seven and eight) from three public schools in New York City. 
The statements were presented on two forms which differed 
only in the wording of the most specific item. The most 
specific item on Form 1 provided a verbal description of a 
word problem, while the most specific item on Form 2 
included an example of a word problem. On each form, the 
same basic itemf> were presented with three different levels 
of specificity. For example, responses were obtained to 
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statements wirh "math," (general level of specificity), 
"word problems," (a more specific level), and either the 
phrase, "word problems with adding or subtracting decimals" 
or an actual word problem using decimals (very specific) . 

Students indicated how true each statement was for them 
on a scale from 1, VERY TRUE, to 5, NOT AT ALL TRUE. Table 
3-3 presents the results for statements about anxiety and 
confidence, written at different levels of specificity. The 
percentages in the table represent the students responding 
VERY TRUE plus TRUE in Example 1 and VERY TRUE in Example 2. 

As shown in Table 3-3, student responses varied 
according to the level of spe'^ificity at which the 
statements about vr/,thematics ^re written. In each example 
differences among the levels c specificity were found. 
Example 2 presents the shift fojL the Confidence statements. 
Students expressed less confidence when asked about learning 
to do mathematics homework problems described in words, than 
when they were actually given an example of a word problem. 
The use of very specific topics and problems was not 
feasible given the range of grades and types of classes for 
which the MAQ is intended. Therefore, it was decided to use 
the level of specificity "mathematics word problems" in the 
MAQ. It is more specific than "mathematics" and more 
directly links to the questionnaire's emphasis on 
applications to mathematical word problems. 

Usefulness of Sample Statements for Teachers 

Question 1; Do Teachers Find the Sample Statements Useful? 

As part of the early pilot studies, teachers were asked 
to rate the usefulness of sample Metacognitive, Self- 
Regulatory and affective belief, motivation and attribution 
statements. Sample statements were administered in four 
classes. The teachers in these classes were asked to review 
their students' responses tc the stateinonts and provide 
feedback concerning the usefulness the responses would have 
for teachers. Their responses were reviewed and used to 
revise the statements. 



Spring 1988 Pxlot 8tu3y 



A pilot study was conducted during April and May of 
1988. During the first phase of this study, the Mathematics 
Assessment Questionnaire - Pilot Questionnaire was 
developed, based upon the results of the early pilot 
studies. During the second phase of the pilot study, the 
statements were administered to students in grades seven, 
eight and nine attending either junior or senior high 
schools in New York City. 
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TABLE 3-3 

Percentage of Students Responding TRUE or VERY TRUE to 
Statements Varied in Level of Specificity for Two 
Psychological Constructs: Anxiety and Confidence. 

Example 1: ANXIETY 



Level cf 
Specificity 



Statement 



General: 
Specific: 



Very 

Specific: 
(words) 

Very 

Specific: 
(example) 



I worry when I have to do math* 

I worry when I have to do math word problems 
for homework. 

I worry when I have to do math word problems 
where I must multiply fractions for homework. 



I worry when I have to do math word problems 
like this for homework: 

The traffic light changes every 20 seconds. 
How many times will it change in 1-1/2 
hours? 



Percentage of Students Responding 
Very True or True 



Level of 
Specificity of 
Statement 



Form 1 
(H=105) 



Form 2 
(li=104) 



General : 

Specific: 

Very Specific: 
(words) 

Very Specific: 
(example) 



31i 
20% 
35% 



31% 
17% 



40% 



Percentages indicate students who responded VERY TRUE or 
TRUE. 
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TABIiE 3-3 (Continued) 
Example 2: CONFIDENCE 



Level of 
Specificity 



Statement 



General : 
Specific: 



Very 

Specific: 
(words) 

Very 

Specific: 
(example) 



I know I can learn to do most math problems. 

I know I can learn to do most math homework 
problems which involve word problems. 

I know I can learn to do most math homework 
problems which involve word problems with 
several addition steps. 

I know I can learn to do most math homework 
problems like this: 

A Softball team won 15 games, It lost 3 
more than it won. How many games has the 
team played? 



Percentage of Students Responding 
Very True 



Level of 
Specificity of 
statement 



Form 1 
(H=105) 



Form 2 
(li«104) 



General: 

Specific: 

Very Specific: 
(words) 

Very Specific: 
(example) 



71% 
53% 
47% 



74% 
54% 



72% 



Percentages indicate students who responded VERY TRUE. 
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Phastt 1 

D^v^lopBMt of thm Mathooaatios Assassmant Quastionnaira - 
Pilot Quaationnaira 

The Domain Specifications for the Mathematics 
Assessment Questionnaire - Pilot Que stionnaire are presented 
in Table 3-4, With the exception of the Metacognitive 
statements, items were written bathed upon a facet design 
which linked three dimensions: 

1) Mathematical topic and task variables 

2) Situation/ learning setting 

3) Psychological constructs, including self- 

regulation 

The mathematical content. Dimension 1, was in effect 
held constant by using the term, "mathematical word 
problems." In the Pilot Questionnaire, eight settings for 
learning were used* These include individual work settings 
(Homework and Deskwork) , large group or classroom work 
settings (During Class), small group or co-operative group 
4^ork settings (Working With Other Students) , and evaluative 
settings (Taking a Test, Getting a Grade, Taking the City- 
Wide Test, Evaluation of Self), The psychological 
constructs are grouped into five categories: Metacognition, 
Self-Regulation, affective beliefs, attributions, and 
motivations • 

The 96 possible pairings of psychological constructs by 
settings (P=12 x S=8) are depicted in Figure 3-1* Since the 
Metacognitive statements are not linked to a specific 
setting, this psychological construct is not included* Of 
these pairings, 94 ware used in the Pilot Question! iire* 
The two categories excluded were: 

Internal Learning Goals - Teacher Grading; and 
External Perfoinnance Goals - Evaluation of Self 

These two categories were excluded since it was felt the 
setting and psychological construct could no logically be 
linked* In each instance, o e was externally based while 
the other was internally basea. 

Metacognitive Statements 

As discussed in a previous section, several early pilot 
studies were conducted to help develop the Metacognitive^ 
prompts or statements. Before inclusion in the Mathematics 
Assessment Questionnaire - Pilot Questionnaire , the 
statements were reviewed by mathematics teachers for their 
meaning and usefulness for instructional planning* The 
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TABLE 3-4 

Mathematics Assessment Questionnaire - Pilot Questionnaire 
Domain Specifications: Item Pool Facets 



Dimension 1; Mathematical Topics and Task Variables 

Mathematical Content 

Whole number, Patterns 

Rational Numbers: Decimals, Fractions, Percents 

Raitios , Proportions 

Geometry, Basic Measurement Concepts 

Probability, Statistics 

Computer Awareness 

Mathematical Operations (addition, subtraction, 
division, ruultiplicc:tion, graphs) 

Mathematical Process 

Word Problems (routine on^-step, routine multi- 
step, nonroutine one-step, nonroutine multi- 
step) 

Concepts 

Computation 

Problem Format 

Response Format (op^n ended) 

Structure ct the Problem (how presented) 

Length of Problem 

Problem Difficulty 
Easy 
Average 
Hard 

Dimension 2: Situation/learning settings 

Individual work 

DesJcwork (seat-work) 
Homework 

Large group (teacher directed) instruction 
Small group (teacher absent) learning 
Evaluation (what "product," who evaluates) 

By standardized tests 

By teacher made test 3 

By self 

By teacher grading 
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TABLE 3-4 (continued) 

Dimension 3: Psychological Constructs 

Metacognition: Self Directed Attention and Cognitive 
Effort while working on a single problem 

Planning, goal setting, defining objectives: 

Before you begin 
Monitoring progress, keeping tracK: 

As you work 
Judging , evaluating , reviewing : 

After you are done 

Self-regulation: Self Directed Attention and Cognitive 
Effort during activity settings 

Planning, goal setting, defining objectives: 

Before you begin 
Monitoring progress, keeping track: 

As you work 
Judging , evaluating , reviewing : 

After you are done 

Affective Beliefs 

Mathematics as a subject, how to do math 

Utility/value of math 

Expectancy of success, confidence 

Self as an active learner, how learning is 

structured 
Interests 

Anxiety concerning mathematics 

Attributions (role of ability and effort) 
Internal, stable, controllable 
Internal, stable, uncontrollable 
External, stable, uncontrollable 
Unknown control 

Motivation 

Internal learning goals (intrinsic) 
External performance goals (extrinsic) 
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FIGURE 3-1 

specification for the Mathematics Assessmer/. Questionnaire; 

Pilot Questionnaire 
z^rTTVTTY SETTING 



PSYCHOLOGICAL CONSTRUCT 

Ketacognitive: Solving « mlh problem 

.before you beg in, planning, 

defining objective, setting goals 

.as you work, isonitoring progress, 
keeping track 

.after you finish, evaluating, 
judging 

.strategies euployed 

Self- regulation 

.planning before begin, 

defining objective, setting goals 

.as you work, wonitoring progress, 
keeping track 

.after evaluation, judging what done 



Affect.. 2 Beliefs 
.math as a subject 
.utility, value of math 
.expectancies of success/confidence 
.anxiety 
.interest 

.self as active learner/ 

how like to structure learning 

Motivation 
.internal learning goals 
.external performance goals 

Attributions 
.internal stable controllable 
.internal stable uncontrollable 
.external stable incontrollable 
.unknown control 



Direct Work in 1 
Seatwork Ho«iework instruct. GroMp j 


Evaluation 
class city-wide teacher self 


21 MHTACOCMITIVE 1 fSKS 
NOT LIHICEO TO A SETTING - LINKED TO A SPECIFI 
NON-ROUTtUE PR06LEM 


C 





































































































































































































































































































I 



42 



MAQ Technical Report 
III - 17 



result was a set of 21 statements grouped into four 
categories: general problem-solving strategies; and specific 
strategies used before, during, and after solving tha word 
problem. 

Students responded to the Metacognitive statements 
about what they did after they worked the following 
nonroutine coin problem: 

Eight pennies were arranged in a row on a table. Every 
other coin is replaced with e nickel. Then, every 
third coin is replaced with a dime. Finally, every 
fourth coin is replaced with a quarter. What is the 
total value of the coins on the table? 

As mentioned above, this problem was selected because the 
method of solution, although not obvious, is not hey->nd the 
grasp of students in grades seven through nine and is not 
dependent upon knowledge of a specific mathematical topic. 
During the early pilot studies, it was found that junior 
high school students of average mathematics ability were 
able to solve this problem. 

Self-Recmlatorv. Affective Belief. Motivation, and 
Attribution Statements 

Examples of behaviors and thoughts which reflect self- 
regulatory learning and the various affective beliefs, 
motivations and attributions within each activity setting 
were developed based upon a review of the relevant 
literature. This list of behaviors was then used to guide 
the writing of the statements. All statements were written 
so that students could respond to them by indicating how 
true the behavior or thought was for them within the given 
activity setting. The statements were revie;^ed by teachers 
and mathematics educators for their relevance to classroom 
instruction. 

Based upon the results of the early pilot studies it 
was decided to set the level of specificity of the 
mathematics content as "mathematical word problems." Each 
Self-Regulatory and affective belief* motivation, and 
attribution statement was writte^ in the context of a 
specific setting, and the statements necessarily differed 
somewhat across settings. The inclusion of statements with 
somewhat different contents for e'Ach setting added 
variability. Yet, research suggests that the 
appropriateness and use of various types of self-regulatory 
behaviors a*e closely associated with the setting in which 
the behavior occurs. For example, self -regulatory behaviors 
within a group problem-solvin:f setting can include both 
group related factors as well as individual problem-solving 
factors. In contrast, within a t^^acher led or direct class 
instructional setting, students interact primarily with a 
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teacher. Similarly, how affective beliafs, motivations and 
attributions are expressed may differ among settings. 

As shown in Fi^ire 3-1, the Self -Regulatory statements 
were written to enc^^inpass three general types of self- 
regulated behaviors: planning, monitoring, and evaluating or 
checking behaviors. This framework was used across all 
settings. Within the questionnaire itself, the statements 
were grouped into these three categories to provide a 
general orientation or structure for the students: before 
beginning the activity, during the activity, and at the end 
of the activity. 

In order to help assess whether individual statements 
reflected the affective, motivational and attributional 
psychological constructs for which they were written, 344 
items were given to three doctoral students in Educational 
Psychology who were familiar with the study. They sorted 
the items according to the psychological constructs. 
Although agreement varie.d slightly according to , 
psychological construct, the three students agreed with the 
original classification of 166 items (63%). At least two 
students sorted 96% of the items into the categories for 
which they were written. Guided by these results, items 
were rvswritten, reclassified or discarded. 

A minimum of three self-regulatory, affective belief, 
motivation and attribution statements per cell (see Figure 
3-1) were included in the Mathematics Assessment 
Questionnaire - Pilot Questionnaire . By including a minimum 
of three items per cell- when responses were inconsistent 
across the statements it was possible to assess which two of 
the three statements were responded to similarly, when 
responses were inconsistent across statements. 

Attempts were made to balance positive and negfitive 
statements within cells (i.e., one item positive and two 
negative or one negative and two positive) . Across the 
broader activity categories, even or balanced representation 
of positively and negatively worded items was attemptci. 
For example, for the individual work category (DeskwoiK and 
HoF^ework) , attempts were made to include a total of ^ 
positive items and 3 negative items. 

Design of the Three F r crns of the Pilot Questionnaire 

Since there were 4bv statements, too many for one 
student at the junior high school level to complete r^'uring a 
40 minute class, the statements were printed in three 
booklets for administration. Table 3-5 presents an overview 
of the constructs represented in each booklet. 

* Form I has thr^^e sections. In Part I students sc-ve a 
word problem and then respond to the 21 Metacognitive 
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TABLE 3-5 

Sximmary of Constructs Included on the Three Forms of the 
Mathemat. cs Assessment Questionnaire - Pilot Questionnaire 



Form I: Metacognitive statements 
(182 items) (with accompanying word problem) 
Self -Regulatory statements 
Selected affective belief, motivation and 
attribution statements (See TABLE 3-5A) 

Form II: Affective Belief i^tateroents 
(187 items) (represented in all eight settings) 

Anxiety . 
Confidence 
Interest 

Mathematics as a Sxibject 
Value 

Self as an Active Learner 
General statements 

(not represented in a setting) 

Form III: Attribution and Motivation statements 
(170 items) (represented in all eight settings) 

Internal Stable uncontrollable 
Internal Stable Controllable 
External Stable Controllable 
Unknown Control 
Internal Learning Goals 
External Performance Goals 
Self as an Active Learner 



statements about what: they did while solving the 
problem. Part II includes the Self -Regulatory 
statements, specific thoughts and activities while 
learning or working word problems in the eight 
classroom activity settings. Part III includes some 
items that are also on Form II and/or Form III (see 
Table 3-5A) . 

* Form II includes statements assessing students' 
anxiety about, valuing of, interest in, and confidence 
in doing mathem-itics word problems in the various 
settings, as^ well as the^r beliefs about mathematics as 
a subject, and self as an active learner of 
mathematical word problems in the different settings. 
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* Form III includes items that are intended to elicit 
students' motivations and attributions — the reasons 
to which they attribute their success or failure. 

The response categories are YES, MAYBE and NO for the first 
21 statements on Form I. All the other items, for all three 
forms, have the response categories VERY TRUE, TRUE, SORT OF 
TRUE, NOT VERY TRUE, and NOT AT ALL TRUE, a scale from one 
to five. 

Each form had a "mini-pool" of 22 common items. All 
forms included statements for the construct "Self as an 
Active Learner." In addition there were items which \/ere 
shared by two forms. Table 3-6 presents the number of items 
unique to a given form, shared by two forms, and common to 
all forms. It also indicates the approximate percentd.ge of 
students in the pilot study sample answering each st^teiient, 
of a total of 1557 students in the sample. 

Phase 2 

Administration, Sample Description, and Analyses oi the 
Mathematics Assessment Questionnaire - Pilot Questionnaire 

Administration 

During April and May of 1988, seventh, eighth and ninth- 
grade students in New York City were administered the three 
forms of the Mathematics Assessment Questionnaire - Pilot 
Questionnaire . The booklets were randomly administered 
within classrooms in nine New York City public schools and 
one parochial school. A total of 10 schools were included, 
with 21 grade seven classes, 22 grade eight classes and 20 
grade nine classes. 

The numbers of classrooms in which students were 
recruited for the pilot study are shown in Table 3-7 by 
grade and type of school. Different types of schools were 
included since seventh, eighth and ninth-grade students in 
New York City may attend a variety of schools: Public 
Schools - PS (grades 1-7), Intermediate Schools - IS (grades 
6-8), Junior High Schools - JHS (grades 7-9) or High Schools 
- HS (grades 9-12). Although the majority of seventh and 
eighth-grade students attendeo an IS or JHS located either 
in Brooklyn or the Bronx, one PS school in Brooklyn was also 
included. The ninth-grade students attended either JHS or 
HS schools, in either the Bronx or Staten Island. All 
students were English-speaking and in the middle range of 
average achievement in math; neither low remedial nor high 
gifted classes were included. 



^ Copies of the three forms of the Pilot Questionnaire are 
available from the authors. 
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TABLE 3-5a 



Psychological Constrxicts by Activity setting Included on the 
Mathematics Assessment Questionnaire - Pilot Questionnaire, 

Form I - Part III 



Activity 
Setting 




Psychological Constructs 


1 
X 


Deskwork 




ISC 


SAL 


rioine w o i.k 






SAL 


During 
Class 


MAS 


ISU 


SAL 


Working With 
Other Students 


Conf idenc 


e ESU 




Taking a Test 
(Classroom) 


Anxiety 


UK 


SAL 


Getting a Grade 


Value 


EPG 


SAL 



Psychological Construct 



VALUE Value (3 items) 

INTEREST Interest (3 items) 

CONFIDENCE Confidence (3 items) 

ANXIETY Anxiety (3 items) 

ILG Internal Learning Goals (4 items) 

EPG External Performance Goals (3 items) 

ISC Internal stable Controllable (3 items) 

TSU Internal Stable Uncontrollable {3 items) 

ESU External stable Controllable (3 items) 

UK Unknown Control (4 items) 

TAL Self as an Active Learner (22 items 

MAS Mathematics as a Subject (5 items) 



47 



KkU Technica?v Report 
III - 22 



TABLE 3-6 

Number of Common^ Shared, and Unique Xtems 
on Each of the Three Foras of the 
Mathematics Assessment Questionnaire - Pilot Questionnaire 
and Percentage of Sample Responding to Each Form 





Form I 


r orm jll 


TToY-m TTT 


jrSJb wis iUa^e UJU 

saunple taking 
X wems 


common 


22 




22 


100% 


shared 


18 


18 




67% 


shared 


19 




Id 


67% 


shared 




8 


8 


67% 


unique 


123 






33% 


unique 




139 




33% 


unique 






121 


33% 


Total 


182 


187 


170 




Items 
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Table 3-7 

Number of Classes and Jchools Grouped by School Type and 
Location for the Pilot Study 



School Type 
and Grade 



Pxiblic Schools 
grade seven 
eight 



School Location 
Brooklyn Bronx Staten Island 



Intermediate Schools 1 
grade seven 4 
eight 4 

Junior High Schools 
grade seven 
eight 
nine 

High Schools 1 
grade nine 5 

Total Number 21 
of classes 



Total : 



2 
5 
6 

3 
8 
8 
8 



2 
7 



35 



seventh-grade n=21 classes 
eighth-grade n=22 classes 
ninth-grade n=20 classes 



N=63 classes 



PS 
IS 
JHS 
HS 

N 



school 
schools 
schools 
schools 



10 schools 



Number of schools. 
Number of classes. 
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Forms were spiraled for distribution within class (Form 
I, Form II, Form III, Form I, Tom II, Form III... ). 
Instructions were read by the classroom teacher during the 
administration of the Pilot Questionnaire, with a member of 
the project staff present. It was informally observed 
during the administration that students had the most 
difficulty understanding the statements on lorm III 
(attributions and motivations) . This form included the most 
lengthy statements, which were also generally the most 
complex statements. Form I was most easily completed by the 
students . 

Sample 

A sample of 1557 r.tudents responded to the three forms 
of the Mathematics Assessment Questionnair e - Pilot 
Questionnaire . Approximately equal numbers of students from 
each grade participated. The responses were scanned 
visually to identify pattern markings. For example, one 
student made "zig-zag" circles across the pages, others 
marked a single response across all statements. These 
booklets were excluded from the analyses. A total of 189 
booklets were eliminated because students left over 50% of 
th6: items blank or because students randomly checked 
responses. Qf these 189 forms, 52 were obtained from 
seventh-gradf^rs , 57 from eighth-graders, and 80 from ninth- 
graders. The sample for the analyses consisted of 460 
students who responded to Form I, 476 students who responded 
to Form II and 432 students who responded to Form III. The 
exclusion of booklets accounts fc. the variable sample sizes 
for the three forms. 

The sex, grade level and age distributions for each 
form of the Pilot Questionnaire are given in Table 3-8. 
There were more females than males completing the 
questionnaires and more seventh-grade students than eighth 
or ninth-grade students. Students' ethnicity was visually 
classified: approximately 1/3 were Black, 1/3 Hispanic and 
1/3 White. 

Data Analyse s 

The general objectives of the data analyses were to 
reduce the size of the item pool and to examine the 
structure of the domain in relation to the item facets. A 
specific goal was to have a single questionnaire which could 
be administered during one 40 minute class period, making it 
more likely that the questi<" naire could be used within the 
c'-.rrent school schedule. A ^urther goal was to main^:ain the 
representativeness of the structure of the domain 
specifications originally identified (s^^e Figure 1-1 and 
Figure 3-1) . Since different students answered each form, 
respc *=tes to Forms I, II, and III were examined separately. 
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TABLE 3-8 

Sex, Grade Level and Age of Students Who Responded to the 
Mathematics Assessment Questionnaire - Pilot Questionnaire 

Form I Form II Form III 

(N«460) (N-476) (N-432) 





N 


% 


N 


% 


N 


% 


Sex 
Males 


177 


( 38 . b; 






xoo 




Females 


255 


(55.4) 


268 


(56.3) 


248 


(57.4) 


Missing 


28 


( 6.1) 


12 


( 2.5) 


16 


( 3.7) 


Grade 
Seven 


164 


(35.7) 


172 


(36.1) 


162 


(37.5) 


Eight 


143 


(31.1) 


144 


(30.3) 


129 


(29.9) 


Nine 


123 


(26.7) 


123 


(25.8) 


116 


(26.8) 


Missing 


30 


( 6.5) 


37 


( 7.8) 


25 


( 5.8) 


Age 
11 


5 


( I.l) 


4 


( .8) 


4 


( '9) 




O X 






(11 2\ 


79 


(18 . 3) 


13 


129 


(28.1) 


147 


(31.0) 


119 


(27.5) 


14 


127 


(27.7) 


119 


(25.0) 


127 


(29.4) 


15 


80 


(17.4) 


80 


(16.9) 


66 


(15.3) 


16 


23 


( 5.0) 


26 


( 5.5) 


16 


( 3.7) 


17 


7 


( 1.5) 


4 


( .8) 


8 


( 1'9) 


18 


2 


( '4) 


3 


( .6) 


2 


( .5) 


Missing 


6 


( 1.3) 


11 


( 2.3) 


11 


( 2.5) 



5i 
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Based upon the following analyses, statements were retained, 
revised or deleted. 

Item distributions and inter-correlations 

The first question addressed was whether the three 
grade levels — seven, eight, and nine, could be pooled for 
purposes of analysis. The individual item distributions, 
means, and correlations among individual items based upon 
responses from each of the three grade levels were examined 
for each form- These comparisons suggests there were no 
systematic, meaningful differences between any of the forms. 
Therefore the responses of the three grades were pooled, 
providing maximum sample sizes on each form. 

Factor analyses and internal consistency analyses 

The second question addressed was the dimensionality of 
the item pool in relation to the original domain 
specifications. The dimensionality of the item pool was 
examined using factor analyses and the internal consistency 
of responses was examined using coefficient olpha 
reliabilities. 

Metacoanitive St^ "^ments ; The 21 Metacognitive statements 
were subjected tc a principal axis factor analysis. The 
two, three and the four factor solutions were examined. The 
two factor solution accounted for 20.3% of the variance, the 
three factor solution accounted for 24.6% of the variance 
and the four factor solution accounted for 27*2% of the 
variance. Although the four factor solution did not exactly 
replicate the grouping used in the Pilot Questionnaire, it 
supported the general structure which was proposed. 

Coefficient alpha reliabilities were computed based 
upon the groupings used in the Mathematics Assessment 
Questionnaire - Pilot Questionnaire . The coefficients 
ranged from .30 (strategies) to .58 (after working the 
problem). They are presented in Table 3-9. Based upon the 
results of the factor analyses and examination of the 
reliabil5.ty coefficients, one Metacognitive item was dropped 
and ona item was reclassified. 

Self-Recmlatory Statements ; Separate factor analyses were 
performed using the Self-Regulatory statements within each 
activity setting. The two, three and four factor solutions 
were examined. The three factor solutions accounted for 
between 33.7% of the variance (During Class setting) and 
57.7% of the variance (Getting a Grade setting). Within the 
Working With Qther Students setting, the three factor 
solution accounted for 37.4% of the variance. The three 
factor solution of the Homework items accounted for 43.1% of 
the variance. 
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TABLE 3-9 



Coefficient Alpha Reliabilities for the Metacognitive Items 
of the Mathematics Assessment Questionnaire - 
Pilot Questionnaire 



Activity 
Setting 


Item 
Nvunbev 


Coefficient 
Alpha Reliabilities 


Before 


1- 6 


.458 


During 


7-11 


.489 


After 


12-16 


.583 


Strategy 


17-21 


.380 



Table 3-10 presents the coefficient alpha reliabilities 
for the Self -Regulatory items based upon the groupings u^ed 
in the Pilot Questionnaire. These values ranged from .51 
(Doing Homework: While Working) to .82 (Evaluation f Self). 

Based upon an examination of the factor analyses and 
the reliability estimates, items were revised, rewritt n or 
dropped for the thr^>e settings selected for the curre 
version of the Mathematics Assessment Questionnaire . Within 
the During Class setting, one item was dropped. Within the 
Working With Other Students setting, two items were revised. 
Two items were dropped, one item was reclassified *nd two 
items were rewritten in the Homework setting. 

Affe::tive Belief, Motivation and Attribution Stateiaents; 
Two sets of factor analyses were performed using the 
affective belief, motivation, and attribution items: 

a) within psychological construct across settings 

b) within setting across psychological constructs. 

The factor analyses were done for each construct. 
Similarly, all items written to assess constructs within the 
activity setting of "During Class** on a gi/en form were 
entered into another factor analysis. Thus, different 
settings or a number of different constructs wvre included 
in each analysis. These analyses failed to reveal clear, 
interpretable factors. The lack of interpretability 
appeared due in large measure to the heterogeneity of 
responses since several settina or construc*:s with between 
three and five items each were included in each analysis. 
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TABLE 3-10 

Coefficient Alpha Reliabilities for the Self -Regulatory 
Items of the Mathematics Assessment Questionnaire - 

Pilot Que/stionnaire 



During Class 

Before 1- 6 .640 

During 7-14 . 625 

After 15-20 .804 

Working With Other Students 

Before 21-27 •728 

During 28-35 -797 

After 36-43 .806 

Working at Your Desk 

Before 44'*46 ,605 

During 47-49 .536 

After 50-52 .649 

Doing Homework 

Before 53-55 .626 

During 56-58 .506 

After 59-61 .609 

Tciking a Class Test 

Studying 62-64 .811 

Before 65-67 .730 

During 68-70 .572 

After 71-73 .579 

Taking the City-Wide Test 

Before 74-76 .617 

During 77-79 659 

After 80-83 .725 

Getting a Grade 

Before 84-86 .776 

During 87-89 .755 

After 90-92 .80 



Evaluating Self 



93-102 .825 
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For example, all items which were written to assess Interest 
were factor analyzed (within construct, across settings). 

A second approach was taken to the question of 
dimensionality. The internal consistency of responses 
within individual cells of the domain specifications was 
examined for the three item clusters. Coefficient alpha 
reliabilities were computed for items within each of the 
cells, after adjusting for the direction of the wording. 

The coefficients are presented in Table 3-11. As Table 
3-11 indicates, the reliability coefficients for two 
constructs — Self as an Active Learner and Mathematics as a 
Subject, werr low and inconsistent across most settings. An 
examination of the statements suggested that these 
constructs represented a heterogeneous group of statements. 
For the remaining constructs, the coefficients ranged from 
.00 to .79, with a mean of .52. 

For the settings and constructs retained for Phase 3, 
several items were rewritten to increase the internal 
consistency estimates. Exmination of the coefficient alpha 
reliabilities, correlations among the items within a 
cluster, and the change in the reliability estimate when 
statements were included or excluded within a cluster, 
provided guidance for adding, revising, or deleting 
statements . 

Phase 3 

Revision of Item Pool and Development of the Mathematics 
Assessment Questionnaire 

The revision of the item pool and the development of 
the present veri^ion of the MAQ was guided by two 
considerations. The first was programmatic, the need for a 
questionnaire that would fit within the typical school 
schedule for mathematics classes, a 40-minut:e class period. 
The second was theoretical, to retain a model of the domain 
structure which included both settings and psychological 
constructs. Thus, for the purposes of the Fall 1988 
administration it was necessary v j limit the questionnaire 
to the number of statements which students could complete 
within a single 40 minute class period. A single 
questionnaire that included the major elements of the entire 
item set would permit assessment of the facet approach as 
well as the general structure of the domain specif ications. 

It was decir'ad to retain 10 psychological constructs: 
Value, Interest, Confidence, Anxiety, Internal Learning 
Goals, External Performance Goals, Internal Stable 
Controllable, Internal Stable Uncontrollable, External 
Stable Uncontrollable and Unknown Control. It was also 
decided to focus upon three activity settings: During Class, 
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Table 3-11 

Coefficient Alpha Reliabilities for Three Item Clusters 
Mathematics Assessment Questionnaire ^ Pilot Questionnaires 



Psychological During Working 

Construct Class W/Others Deskwork Homework 



Value 


.513 


.559 


.499 


. 694 


Interest 


'90 


.647 


.703 


.765 


Confidence 


543 


.498 


.647 


.640 


Anvietv 


. 566 


. 575 


.670 


.439 


Internal 
Learning Goals 


.476 


.362 


. 304 


.493 


External 

Performance Goals 


.488 


.499 


.509 


.453 


Internal Stable 
Controllable 


.383 


.269 


.314 


.177 


Internal Stable 
Uncontrollable 


.522 


.366 


.402 


.370 


External Stable 
Uncontrollable 


.313 


.505 


.501 


.662 


Unknown Control 


.486 


.653 


.621 


.611 


Aath as a Subject 


-.198 


.633 


.211 


.247 


Self as an Active 
Learner (Form I) 


.394 


.320 


.147 


.035 


Self as an Active 
Learner (Form II) 


.443 


.370 


.274 


.001 


Self as an Active 
Learner (Form III) 


.352 


.375 


.039 


-.053 
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Table 3-11 (continued) 



Psychological Taking a 
Construct Test 


Taking the 
City-Wide 


Getting 
a Grade 


Evaluation 
of Self 


Value 


.670 


578 


.794 


.002 


Interest 


.636 


.520 


.740 


.725 


Confidence 


.676 


.644 


.m 


.510 


Anxiety 


.696 


.738 


.456 


.311 


Internal 
Learning Goals 


.519 


.507 


.517 


.515 


External 

Performance Goals 


.326 


.661 


.433 


a 


Internal Stable 
Controllable 


.436 


.264 


.454 


.282 


Internal Stable 
Uncontrollable 


.517 


.303 


.433 


.369 


External Stable 
Uncontrol 1 able 


.618 


.278 


.676 


.261 


Unknown Control 


.667 


.624 


.694 


.677 


Math as a Subject 


.357 


.247 


.356 


.545 


Self as an Active 
Learner (Form I) 


-.083 




.228 


a 


Self as an Active 
Learner (Form II) 


-.327 


-.189 


.449 


.697 


Self as an Active 
Learner (Form III) 


-.199 


-.305 


.205 


.590 



Note : The negative alpha coefficients are a result of 
logical keying of the items. 



Items not included for this activity setting. 
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Working With Other Students, and Doing Homework. The 
decision was made to focus upon these settings because: 

a. These settings were most significant for teachers 
in relation to planning instruction in daily classroom 
activities. 

b. The Deskwork (seatwork) and Homework settings 
appealed to be closely related since both are 
individual \/ork activities for students. It was 
therefore decided to retain only one of the individual 
settings , Homework. 

c. The four Evaluation settings: Taking a Test, 
Getting a Grade, Taking the City-Wide Test and 
Evaluation of Self, were felt to represent a distinct 
grouping of items which could be examined as a separate 
unit. These settings were judged to be lers central to 
pla^ining on-going instructional activities. 

Two psychological constructs. Mathematics as a Subject 
and Self as an Active Learner were not retained. An 
examination of the coefficient alpha relieibilities indicated 
limited consistency of responses to these statements. 
Further, the general items on the second fora, that is the 
items which were not linked with a specific setting, were 
not included. 

In summary, the final ret of items which constitutes 
the Mathematics Assessment Questionna ire was based upon the 
analyses of the 1983 Pilot Questionnaire. A set of 161 
statements and one question about how often the student 
works in a group with other students forms the revised 
booklet for the Mathematics Assessment Questionnaire . 
Appendix 3-1 presents the questionnaire booklet with each 
item classified for the constructs for which it was written. 
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CHAPTEil IV 

EVMiUATION OF THE MATHEMATICS ASSESSMENT QUESTIONNAIRE: 
RELIABILITY AND VALIDITY RELATED EVIDENCE 

In the fall of 1988, data were collected using the 
current form of the Mathematics Assessment Qu estionnaire > 
This chapter describes the administration, sample and 
analyses for evaluation of t>ese data. 

Aditinistration a^4 Sample Description 

The Mathematics Assessment Questionnaire was 
administered to 2658 students in grades seven, eight and 
nine at eight New York City public schools. The criteria 
for selecting students and classes were that students read 
at the seventh-grade level and that the classes were not at 
the very top (gifted) or very bottom (low remedial) of the 
mathematics sections in the school. The MAQ booklets were 
administered during one 40 minute class period with project 
staff present. The class teacher read the instructions to 
the students. Students' questions were answered by either 
the classroom teacher or project staff. 

Two hundred seven students were not included in the 
sample for analysis because they answered fever than half 
the pages in the MAQ booklet. Of these 207 students, 64 
were seventh -graders, 80 were eighth-graders and 63 were 
ninth-graders. The remaining sample of 2451 stud'snts is 
referred to as the "Total Sample." Although these 2451 
students answered state'*aents on at least eight of the 15 
pages of the MAQ, raany students omitted individual 
stateLants. The "Data Analysis Sample" included 1737 
student'*; who responded to all pages ir the booklet. 
Although these students answered statements on all pages of 
th^: booklet, they did not necessarily respond to each 
statement. This results in different sample sizes for some 
analyses. Table 4-1 presents the sample sizes and average 
number of missing responses per student for both the Total 
Sample and Data Analysis Sample. For the Total Sample, the 
number of missing responses per student ranged from 0 to 
114, with an average of 13.83 and a standard deviation of 
23.08. For the Data Analysis Sample the number of missing 
responses per student ranged from 0 to 81, with an average 
of 2.08 (SD==5.32). Thus, students included in the Data 
Analysis Sample responded to an average of 159 statement':^ 
out of the 161 statements included on the MAQ. 

Table 4-2 presents the demographic information 
including grade, se:c ind age for the Total Sample (N=2451) 
and Data Analysis Sample (N=1737). The Total Sample and the 
Data Analysis Sample weie similar in terms of these 
demographic indic<xtors. For purposes of the data analyses 
in the remainder or* this chapter the Data Analysis Sample 
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TABLE 4-1 

Number of Students and Haximtim Nimber of Missing Responses 
for the Total Sample and Data Analysis Sample by Grade 





Total Sample 
(N-2451) 


Data Analysis Sample 
(N«1737) 


Grade 


No. of 

students 


Mean No. 
of missing 

responses 
per student 


No. of 

students 


Max. No. 
of missing 

responses 
per student 


Seven 


905 


14.87 


6u0 


2.37 


Eight 


876 


15.91 


602 


2.18 


Nine 


670 


9.70 


535 


1.64 


Total 


2451 


13.83 


1737 


2.08 



was used. As Table 4-2 indicates, approximately one-third 
the svadents in this sample were in each of grades seven, 
eight and nine. Forty- four percent of the students vere 
male, 56% female. The students ranged in ?tge from 11 to 16 
years, with the majority of students (93%) between J.i and 14 
years of age. Self-reported ethnicity was: 8? Asian, 22% 
Black, 22% Hispanic, 43% White, 13% Other, and 2% not 
responding. The ethnic breakdown of students within the 
Total Sample (students who completed at least half the MAQ) 
and the Data Analysis Sample were similar. 

In addition to collecting responses to the MAQ, 
students' mathematics achievement scores and reading 
achievement scores were obtained. During the spring prior 
to administration of the MAQ, students in New York City 
school took the Metropolit an Achievemenv Test (MAT) - 
Mathematics test and the Degrees of Reading Power (DRP) . 
These tests are given as part of a city-wide testing program 
in New York City. Both tests provide scaled scores and 
i.ational percentiles normed for grade level The MAT total 
mathematics scores were obtained. These are a composite of 
the student's subtest scores of concepts, computation and 
problem-solving. Achievement scores uexe available for 



CO 



1 
i 
1 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 



MAQ Technical Report 
IV - 3 

TABLE 4-2 

Grade Level, Sex and Age of Students who Responded to the 
Mathematics Assessment Questionnaire 
Total Sample and Data Analysis Sample 



Total Sample 


Data Analysis 


Sample 


(N-2451) 


(N«1737) 


N Percentage 


N Percentage 



Grade Level 
7 


905 


(36.9%) 


600 


(34.5%) 


8 


876 


(35.7%) 


602 


(34.7%) 


9 


670 


(27.4%) 


535 


(30.8%) 


Sex 

Male 


1131 


(46.1%) 


764 


(44.0%) 


Female 


1309 


(53.4%) 


966 


(55.6%) 


No sex 


11 


( .5%) 


7 


( .4%) 


11 years 


62 


( 2.5%) 


38 


( 2.2%) 


12 years 


793 


(32.4%) 


538 


(31.0%) 


13 years 


840 


(34.3%) 


605 


(34.8%) 


14 years 


610 


(24.9%) 


466 


(26.8%) 


15 years 


107 


( 4.4%) 


69 


( 4.0%) 


16 years 


6 


( .2%) 


2 


( .1%) 


No age 
indicated 


33 


( 1.3%) 


19 


( 1.1%) 
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approximately 1500 students, or 87% ot the students in the 
Data Analysis Sample. The largest number of missing 
achievement scores were for the ninth-grade students. 

Table 4-3 present ^ the means and standard deviations of 
the national percentiles and scaled scores on each test by 
grade. The scaled scores used here for the DRP are the Mid 
Instructional Level. National percentiles on both scales 
ranged from 0 to 99. However, the overall mean national 
percentile for the sample was 67% on the MAT and 72% on the 
DRP. Thus, the sampD.e with scores was above the 50th 
percentile on both tests. 

For several analyses which are discussed below, separate 
high and low achieving groups in mathematics were 
constructed. The sample was dichotomized according to 
students' mathematics achievement, as defined by their 
national percentile on the Metropoli tan Achievement Test. 
Based upon the pooled seventh, eighth, and ninth-grade data, 
the top 30% and bottom 30% of the students were selected. 
The mean MAT national percentile for the low group was 
36.^9, with a standard deviation of 12.13. This group 
included 460 students: 135 seventh-graders, 155 eighth- 
graders and 170 ninth-graders. The 457 high achievers 
included 167 seventh-graders, 207 eighth-graders, and 86 
ninth-graders. The mean MAT national percentile of the high 
achievers group was 93.64%, with a standard deviation of 
4.64. 



Appendix 4-1 presents response distributions for 
individual MAQ statt^ments for the data analysis sample. 
Although items written to assess the affective beliefs, 
motivations and attributions were intended to be used in 
three item clusters, the first series of analyses examined 
the data at the individual item level. Several analyse^ 
were performed to assess whether responses of students in 
the three grades (seven, eight and nine) differed. 
Comparison of boys' and girls' responses were also included. 

Differential Use of item Response Categories by Sex 

Research has shown differential use of responses such 
as "I don't know" by boys and girls for achievement test 
items on the National Assessment of Educational Progress 
(Linn, de Bendictis, Delucchi, Harris, & Stage, 1987; 
Suchner, 1990) . Girls tend to use responses such as "I 
don't know" more often than boys. These findings suggest 
that the frequency with which boys and girls respond MAYBE 
to the Metaccgnitive statements or SORT OF -fRUE to the Self- 
Regulatory, affective belief, motivation and attribution 
stater^ents also might differ. The responses were compared 
for boys and girls. 



Item Level Data Analyses 
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TABLE 4-3 

Means and Standard Deviations of MAT and DP'' 
National Percentiles and Scaled Scores by G ade 



Achievement 
Score 



Grade Level 



All Three 

Grades 
Combined 



MAT National Percentile 



Mean 

SD 

N 

Range 



68.61 
23.19 
537 
0-99 



70.08 
24.62 
544 
7-99 



60.37 
23.70 

425 
10-99 



66.81 
24.19 
1506 
0-99 



MAT Scaled Scores 



Moan 

SD 

N 

Range 



663.79 
33.98 
535 
575-757 



683.55 
46. 2S 
544 
595-788 



679.42 
32.50 
425 
614-797 



675.35 
39.49 
1504 

575-797 



DRP National Percentile 



Mean 

SD 

N 

Range 



71.30 
18.82 
547 
0-90 



74.19 
14.94 

535 
21-91 



68.49 
16.91 
413 
2-90 



71.56 
17.12 
1495 
0-91 



DRP Mid-Instructional Level (Scaled Scores) 



Mean 

SD 

N 

Range 



62.90 
9.57 
562 

27-95 



70.69 
9.49 
558 

40-90 



71.61 
10.16 

436 
30-99 



68.13 
10.48 
1556 
27-99 



Metacoanitlve Statements - MAYBE and YES Responses 

The total number of times each student responded MAYBE 
to the 20 Metacognitive statements was examined. The niimber 
of MAYBE responses per student ranged from 0 to 14, with an 
average of 2.76 MAYBE responses per student (SD-2.46). 
Three hundred seventy eight students (22%) , never used the 
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MAYBE category — 165 boys and 211 girls, 22% of each sex. 
Only seven boys (1%) and ten girls (1%) used the MAYBE 
response 10 or more times* A t-test was p^^r formed to 
compare the mean number of times MAYBF was selected by boys 
(M=2*80, SD=2*51) and girls (M'«2*72, SD«2*4i)* The 
difference was not statistically significant: (t (1728) = 
.66) • 

The total number of times each student responded YES 
was also examined* The number of YES responses per student 
ranged from 0 to 19, with an average of 10*58 YES responses 
per student (SD=3*12). Five students (•3%), never used the 
YES category. A t-test was performed to compare the mean 
number of times YES was selected by bo^iz (M»10.22, SD-3.04) 
and girls (K=10.86, SD«3*15). A statistically significant 
difference was found (t (1728) » -4.25, p < -001) • Although 
differences in the use of the YES category were 
statistically significant, the differences were small and 
the sample size is large. Therefore, based upon these 
analyses it was concluded that boys and girls did not 
meaningfully differ in their use of either the MAYBE or YES 
category, 

Self-Reaulatorv Statements - SORT OF TRUE Responses 

The total number of times each studert responded SORT OF 
TRUE to the Self -Regulatory statements within each activity 
setting wa.. examined, SORT OF TRUE is the middle category 
on the one to five rating scale. It might be interpreted 
similarly to an "I don't know" option, a student who chooses 
to not commit to a response. Table 4-4 presents the mean 
number of times boys, girls and the total data analysis 
sample selected SORT OF TRUE within each setting. The 
number of SORT OF TRUE responses to the 19 Self -Regulatory 
statements in the During Class setting ranged from 0 to 16 
per student. Eighty-three (5%) of the students never used 
the middle response category. For the 23 statements in the 
Working With Other Students setting, students responded soi^t 
of true between 0 and 23 times. One hundred twenty-seven 
(7%) of the students never responded SORT OF TRUE to any of 
the 23 statements in this setting. The Homework setting 
included nine Self-Regulatory statements and sr.udents 
responded SORT OF TRUE between 0 and 9 times. In this 
setting, the middle response category was never used by 431 
(25%) of the students. 

To examine whether girls selected the SORT OF TRUE 
category more often than boys, t-tests? were performed. In 
the During Class setting, use of the response did not differ 
between boys' (M«4,34) and girls' (M=4,32), t (1728) « .18. 
In the Working With Other Students setting the difference 
between boys (M=5,06) and girls (M=5.27) was not 
statistically significant (t (1728) = -1,27), The t-test 
comparing boys' (M=l,72) and girls' (M=l,68) use of the SORT 
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TABLE 4-4 

Mean Number of Times Boys, Girls and the Total Data Analysis 
Sample Selected SORT OF TRUE in Response to Self-Regulatory 
Items Within Activity Settings 



Activity Boys Girls Total 

Setting (764) (966) (1737)* 



During Class 
(19 items) 








Mean 
SD 


4.34 
2.47 


4.32 
2.41 


4.33 
2.44 


Working With 

Other Students 
(23 items) 








Mean 
SD 


5.06 
3.45 


5.27 
3.56 


5.19 
3.51 


Homework 
(9 items) 








Mean 
SD 


1.72 
1.55 


1.68 
1.54 


1.70 
1.55 



Total includes seven students not identified by sex 



OF TRUE responses in the Homework setting was also not 
r^atistically significant (t (1728) « .53; • Thus, overall, 
lere were no differences in the use of the middle response 
category by girls and boys. 

Affective Belief, Motivation and Attribution Statements - 
SORT OF TRUE Responses 

The total number of times each student responded SORT OF 
TRUE to the three statements for each psychological 
construct within each activity setting was examined* The 
number of SORT OF TRUE responses within any construct by 
setting could range from 0 to 3, with the exception of the 
Internal xjeaming Goals, Homework setting. This construct 
within the Homework setting included only two items. 
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Tables 4-5 through 4-7 present the mean number of times 
boys, girls and the total data analysis sample selected SORT 
OF TRUE within each setting. In general, girls used this 
middle category more often than boys. Yet, the absolute 
mean difference between boys and girls usage on any 
construct within in any activity setting did not exceed .16* 

To compare boys-^ and girls' use cif the SORT OF TRUE 
category, t-tests were performed, usi..g "''5 as the l^svei of 
significance. In the During Class setti,,^^ two 
statistically significant differences were found. Girls 
selected the SORT OF TRUE more often than boys for the 
Confidence statements (girls^ M-.75, boys M«.S8, t (1728) « 
-4.15, p <: .001) and for the Anxiety statements (girls, 
M=.71, boys M=.59, t (1728^. « -3.20, p < .005)- In the 
Working with Other Student.^ setting, differer.ccis between 
boys' and girls' use of the category were found for two 
constructs: Confidence (girls M=«.74, boys ?i«.61, t (1728) = 
-3.47), p < .005) and Internal Learning Goals (girls M«.82, 
boys M=.70, t (1728) == -.2.89, p < ,005). In both cases 
girls more frequently than boys sels^cted the SORT OF TRUE 
response option. In the HomeworK Sietting^ girls more often 
than boys selected the SORT OF TI<UE response to the External 
Stable Uncontrollable statements (girls M=.81, boys M«.67, 
t (1728) = -3.54, p < .0001}. 

Overall, while one or two constructs in each activity 
setting had statistically significant differences in use of 
the SORT OF TRUE category by girls and boys, tb^ use of the 
category was more similar than different. 

Sex by Grade Level Comparisons - Anovas 

Separate two (sex) by three (grade) way analyses of 
variance, Anovas, were performed using the individual Self-- 
Regulatory, Affective Belief, Motivation and Attribution 
statements as the dependent variables. Since a total of 141 
analyses were performed^ the level of significance was; set 
at p < .0004. In tho folloving sections, the Self- 
Regulatory statements are discussed first, and then the 
affective beliefs, motivations and attributions. 

Self-Regulatory Stocements 

Interactions ; No interactions between sex and grade were 
statistically significant. 

Main effect for Sex : Across the 51 Self -Regulatory 
statements within all settings, 13 statements had a main 
effect for sex. The differences between the means of the 
boys' and girls' responses did not exceed .34 for any item, 
and averaged .23, on the five point response scale. In all 
but one comparison, girls reported more Self -Regulatory 
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TABLE 4-5 

Mean Niuober of Tines Boys; Girls and the Total Data Analysis 
f:anple Selected SOFT OF TRUE in Response to the Thres Itess 
Assessing the Ten Psychological Constructs Within the 
During Class Activity Setting 



Psychologic? 1 
Constxructs 



Boys 
(N=764) 



Girls 
(N-966) 



Total 
(N-1737) 



Value 
Mean 
SD 



,687 
,783 



,748 
,790 



,725 
.789 



Interest 
Mean 
SD 



,687 
,746 



,767 
,795 



.731 
.775 



Confidence 
Mean 
SD 



584 

,761 



,746 
,845 



,675 
,813 



/inxiety 
Mean 
SD 



,592 
,730 



,711 
,803 



.660 
.773 



Internal 
Learning Goals 

Mean 

SD 



.778 
.810 



,765 
,810 



,773 
,810 



Sxten>al 

Performance Goals 
Mean 
SD 



524 
682 



,500 
,658 



,510 
,6&3 



Internal Stable 
Controllable 

Mean 

SD 



,783 
,838 



,819 
865 



,803 
,852 



Internal Steible 
Uncontrollable 

Mean 

SD 



,789 
,837 



,851 
,857 



,824 
,848 



External Stable 
Uncontrollab) e 

Mean 

SD 



,712 
,765 



,724 
.775 



.721 
.772 



ERIC 



Unknown Control 
Mean 
SD 



467 

,715 



67 



,521 
,769 



,498 
.745 
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TABI£ 4-6 

Mean Number of Times Boys, Girls and the Total Data Analysis 
Sample Selected SORT Of TRUE in Response to tim Three Items 
Assessing th Ten Psychological Conoii.^cts Within the 
Working ith Other Students Activity Setting 



Psychological Boys Girls Tot'*! 

Constructs (N-764) (N«So6) (N»173/) 



Value 
Mean 
SD 



.734 
.791 



.712 
,783 



,723 
.785 



Interest 
Mean 
SD 

Confidence 
Mean 
SD 

Anxiety 
Mean 
SD 

Internal 
Learning gc 

Mean 

SD 



,696 
,835 



605 
756 



605 
,748 



.696 
.824 



/16 
.816 



.736 
.803 



.637 
.753 



.819 
.914 



.709 
.825 



,678 
,785 



.623 
.751 



,765 
,877 



External 

Performance Goals 
Mean 
SD 

Internal Stable 
Controllable 

Mean 

SD 



,505 
,705 



,751 
,828 



,51?. 
678 



,797 
,860 



.511 
.690 



.778 
.846 



Internal Stable 
Uncontrol 1 abl e 

Mean 

SD 



,853 
,885 



,905 
,379 



.884 
.883 



External Stable 
Uncontrollable 

Mean 

SD 



,715 
,822 



,771 
,845 



,746 
.820 



Unknown Control 
Mean 
sn 



,588 
,777 



,588 
,769 



,589 
,773 
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TABLE 4-7 

Mean Nximber of Times Beys, Girls and the Total Data Analysis 
Sanplo Selected SORT Oi: TRUE in Response to the Three Items 
Assessing the Ten Psychological Constructs Within the 
Homework Activi+'.y Setting 



Psychological Boys Girls Total 

constructs (N=764) (N=966) (N=1737) 



Value 

Mean .694 .716 .708 

SD .792 .803 .798 

Interest 

Mean .843 .878 .864 

SD .907 .927 .918 

Confidence 

Mean .556 .621 .592 

SD .768 .775 .772 

Anxiety 

Mean .614 .671 .645 

SD .769 .805 .78? 

Internal 

Learning Goals v 

Mean .740 .857 .806 

SD .844 .905 .880 

External 

Performance Goals 

Mean .702 .694 .700 

SD .818 ,796 .809 

Internal Stable 
Controllable 

Mean .865 .952 .914 

SD .934 .926 .930 

Internal Stable 

Uncontrol lable 

Mean .368 .364 .366 

SD .665 .674 .669 

External Stable 

Uncontrollable 

Mean .666 .806 .744 

SD .790 .839 .820 

Unknown Control 

Mean .614 .6''7 .649 

SD .769 .820 .799 



MAQ Technical Report 
IV - 12 

behaviors than boys. The item on which boys reported 
greater self -regulatory behaviors was in the Homework 
setting. 

In the During Clas^: setting, a main effect for sex was 
found for five of the 19 Self-Regulatory statements. These 
are items numbered 10, 15, 17, 18 and 19 on page 6 in 
Appendix 3-1. In this setting, the difference between the 
means of the boys' and girls' responses never exceeded .28, 
an'i averaged .21. Six out of 23 Self-Regulatory items in 
the Workiiig With Other Students setting had a statistically 
significant main effect for sex (r*-^ered 10, 13, 14, 15, 16 
and 17 on page 11 in Appendix 3-3 Of these, only one 
difference between the means exce^aed ,25 ("We check each 
other's ideas"), and had an absolute mean difference of .34. 
In the Homework setting, two out of nine Anovas had a 
.statistically significant main effect for sex. These are 
items 2 and 4 on page 15 in Appendix 3-1. The only item 
which boys (M=2.99) reported was more true than girls 
(M=3.27) was in the Homework setting: "*I decide hov much 
time to spend on my marh homework word problems." 

Main effect for Grade ; Four main effects for grade were 
statistically significant for the Self-Regulatory 
statements. Two differences were found for the 19 
statements of the During Class setting, (items numbered 12 
and 13 on page 6 in Appendix 3-1) , and two differences for 
the 23 statements of the Working With Other Students 
setting, (items numbered 10 and 11 on page 11 in Appe:ndix 
3-1) . In the During Class setting, the largest difference 
was between the ninth-graders who reported greater 
endorsement of the Self -Regulatory statements than the 
eighth-graders . 

Affective Belief, Motivation and Attribution Statements 

Interactions : No interactions between sex and g?cade v/ere 
statistically significant. 

Main effect for Sex ; Examination of the Anovas for the 
individual affective belief, motivation and attribution 
items within the During Class setting revealed that out of 
30 comparisons of items, there were nine statistically 
significant main effects for sex. These are for items 
numbered 20, 22, 25, 35, 37, 41, 44, 46, and 49 on pages 7 
through 9 in Appendix 3-1. The largest mean difference was 
.47, for an Internal Learning Uncontrollable statement ("If 
I can follow my teacher's explanation for word problems, it 
is because I am smart"). Boys reported this statement was 
more true than gir'^s. Sixteen of the 30 Anovas for 
statements within the Working With Other Students setting 
had a statistically significant main effect for sex (Items 
numbered 24, 25, 26, 28, 35, 37, 40, 41, 42, 43, 44, 45, 46, 
47, 49, and 52 on pages 12 through 14 in Appendix 3-1). On 
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all three items which assess Unknown Control, boys reported 
less of a sense of control. Within the Homework setting, 11 
main effects for *^ex were found (Items numbered 12, 14, 15, 
16, 22, 23, 24, 29, 33, 36, 39 on pages 16 though 18 in 
Appendix 3-1) • Sex differences were found in response to 
all three items written to assess the construct External 
Performance Goals. Boys rated the statements in all three 
settings as more true than girls. 

wain effect for Grade ; Ten statistically significant main 
effects for grade on the affective belief, motivation and 
attribution items were found for statements within the 
During Class setting. These are items 20, 21, 23, 26, 30, 
34, 35, 40, 46, and 49 on pages 7 though 9 in Appendix 1-1 • 
The only other difference was for a statement in the 
Homework setting, item numbered 22. The difference in means 
ranged from .24 to .39 with an average difference of .33. 

comparisons of Within Grade Correlations 

Pearson correlations among individual items were 
compared across grades to further investigate differences in 
responses patterns. In order for a difference between 
grades to be considered meaningful, the following criterion 
was set: the difference between any two of the three 
possible pairs of correlations (seventh vs, eighth, seventh 
vs. ninth, or eighth vs. ninth) had to be greater than .20. 
The comparisons we">*e done separately for st atements included 
wi'uhin the During class. Working With Other Students and 
Homework settings. No differences met the criteria. 

An example of a correlation which differed most across 
the three grades in the During Class setting is between 
statements 33 and 20. Statement 33 is, "I usually do not 
know what is going on when my teacher is explaining a word 
problem," and statement 20 is, "I feel confident that I will 
be able to follow any word problem my math teacher explains 
in class." Correlations of the responses to thr two 
statements were: Grade 9: r= -.32, grade 8: r= -.25, and 
grade 7: r= -.13. Based upon the results of both the Anovas 
and correlation analyses, it was decided the grade-level 
data would be pooled for mosr analyses. 

Construct Level Data Analyses 

Although there are no scores reported for the 
Metacognitivre and Self-Regulatory statements, several 
analyses were performed to examine response consistency. 
Coefficient alpha reliabilities were computed for the 
Metacognitive and Self-Regulatory statements as they v^.re 
groupea in the MAQ: before, during or after the activicy. 
The alpha coefficients for the affective beliefs, 
motivations and attributions were calculated based upon the 
three items within each cluster for each setting. 
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Int^imal ConsistMcy Estimates 

Metacoanitive Sta tements 

Alpha reliability coefficients were computed for the 
Metacognitive statements as grouped on the MAQ: before, 
during and after working the word problem. These are 
presented in Table 4-8. The coefficients were modest, 
ranging from .35 to .52. These alphas indicate that the 
hypothesized cate^jories based upon when the activity was 
performed (before, during or after working the problem) were 
not homogeneous. Therefore, factor analyses of the 
statements were examined to determine if more homogeneous 
clusters of the Metacognitive statements c uld be 
identified. (See the section on factor analyses below.) 



TABLE 4-8 

Coefficient Alpha Reliabilities for the Metacognitive Items 
as Grouped on the Mathematics Assessment Questionnaire 

(N=1612) 



Be fore As After Strateg ies 

Metacognition Working Working Working 



Item numbers 1-7 8-11 12-16 17-20 

Alpha .351 .402 .521 .394 



Self -Regulatory Statements 

The Self -Regulatory statements within each of the three 
settings were grouped into three categories: planning and 
goal setting (before) , monitoring progress and keeping track 
(during) and judging, evaluating and reviewing (after). 
Alpha rfc.\iability coefficients based upon items within tach 
of the categories within each setting are presented in Table 
4-9. All coefficients exceeded at least .50, ranging from 
.51 to .84. In general, items in the Working With Other 
Stndents setting were the most internally consistent. 
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TABLE 4-9 

Coefficient Alpha Reliabilities for the Self -Regulatory 
Items as Grouped on the Mathematics Assessment Questionnaire 



Activity Setting 



Self-Regulatory 



During 
Class 
(N=1628) 



Working With Homework 
Others 

(N=1538) (N=1679) 



Planning and Goal 
Setting 

Item numbers 
Alpha 



1-6 
.580 



1-7 
.790 



1-3 
.512 



Monitoring Progress 

Item numbers 
Alpha 



7-14 
.631 



8-15 
.818 



4-6 
.735 



Judging, Evaluating 
and Reviewing 

Item numbers 
Alpha 



15 - 19 
.794 



16 - 23 
.845 



7-9 
.587 



Like the Metacognicive statsments, students' responses 
to the Self -Regulatory items were factor analyzed. Separate 
factor analyses were performed for items within each 
setting. 
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Af fective Belief. Motivation and Attribution Statements 

The MAQ includes three statements to assess each 
psychological construct within each of the three activity 
settings. Coefficient alpha reliabilities were calculated 
to estimate the internal consistency of responses to 
statements within each cluster. 

The coefficient alphas are presented in Table 4-10. 
All coefficient are based upon three items with one 
exception. Examina^'ion of the item-total correlations 
within the Internal Learning Goals in the Homework setting 
reve.^led a negative correlation for Item 15. When item 15 
("I do not like to do ',.ord problems for homework unless I 
can learn something new by doing them.") was logically keyed 
in the same direction as the other two statements: "I like 
to do hard homework word problems because I learn more math 
by working them," and "I like to do challenging word 
problems for homework because solving them helps me learn 
math," the coefficient alpha reliability was .386. However, 
statistically reversing the scoring increased the 
consistency among responses to the three statements. That 
is the coefficient alpha reliabilities increased from .386 
( jgical scoring) to .446 (statistical scoring). Since the 
logical keying and statistical keying did not agree, item 15 
was eliminated. Using the two item cluster resulted in an 
alpha coefficient of .737. All further analyses for 
Internal Learning Goals in the Homework setting are based 
upon the two item cluster. 

Examination of Table 4-10 reveals that the median 
coefficient is .61 and all but three coefficient alpha 
reliabilities exceeded .40. The three exceptions are: 

Value - Working With Other Students (r^^ =.394) 
Interest - During Class (r^> =.335) 

External Performance Goals - During Cl.^ss (r^^ =.203) 

Responses to the statements addressing External 
3rformance Goals within the During Classroom setting were 
zhe least consistent, with a coefficient alpha reliability 
of .203. The cluster of statements addressing External 
Performance Goals within the other two settings had a 
coefficient alpha reliability of .532 (Working With Other 
Students) and .543 (Homework). Thus, only within the During 
Class . ^tting did student respo^ ^es to the three item 
cluster assessing External Performance Goals appear to be 
inconsistent. The correlations for this three item cluster 
indicated heterogeneity among the statements > Examination 
of the content of the External Performance Goals items 
within the During Class setting suggests that the items 
differ in terms of the types of external motivators" and the 
student behaviors examined. 



lERlC 



MAQ Tv shnical Report 
IV - 17 

TABLE 4-10 

Coefficient Alpha Reliabilities for the Three Item Clusters 
of Psycholc>gical Constructs Within ISach Activity Setting 



Activity Setting 



Psychological 
Construct 



During Class Working With Homework 

Others 

(N=1358) (N«1270) (N-1405) 



Value 

Item numbers 
Alpha 



26^28 34 
.500 



32 44 46^ 
.394 



12^20 39^ 
.483 



Interest 

Item numbers 
Alpha 



24 44^49 
.335 



30 36 40^ 
.487 



18 34^28 
.725 



Confidence 
Item numbers 
Alpha 



20 31^48^ 
.548 



24 27^48 
.412 



13*^22 35^ 
.611 



Anxiety 

It m numbers 
Alpha 



27 35^39 
.576 



25 31^51 
.520 



19 26^36^ 
.451 



Internal 
Learning Goals 

Item numbers 

Alpha 



30 32 42 
.710 



29 33 39 
.698 



31 23^ 
.737 



External 

Performance Goals 
Item numbers 
Alpha 



25 36 40 
.203 



37 43 53 
.532 



14 33 29 
.543 



Internal Stable 
Controllable 

Item numbers 

Alpha 



43 45 47 
.620 



34 41 49 
.610 



17 25 37 
.605 
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TABLE 4-10 (continued) 



Internal Stable 
Uncontrollable 
Item numbers 



22 37 41 
.593 



26 38 52 
• 620 



10 16 38 
• 730 



Alpha 



External Stable 
Uncontrollable 
Item numbers 



23 29 46 
• 418 



35 50 45 
• 613 



21 32 27 
• 603 



Alpha 



Unknown Control 
Item numbers 
Alpha 



21 33 38 
• 683 



28 42 47 
• 588 



11 30 24 
• 661 



two item cluster • Inclusion of 3rd item, number 15 with 
logical keying rtt==^386, with statistical keying r^^=^446 
- two items were retained • 
^ items with reversed scoring • 



The three External Performance Goal items are: 

25 • I only answer questions about word problems in 
math class to please my teacher • 

36 • I pay attention when my teacher explains word 
problems if I know I will have a test on them^ 

40 • I volunteer to do a word problem on the board if I 
think it will help my grade • 

The coefficient alpha reliability for statements 
addressing Interest in working word problems During Class 
was ^335^ The three-item Interest clusters were somewhat 
more consistent in the other settings: ^487 in the Working 
With Other Students setting, and .725 in the Homework 
setting. 

contparisons Across Settings 

Additional coefficie t alpha reliabilities were computed 
using items combined for pairs of activity s^.ttings: During 
Class and Working With Other Students, During class and 
Homework, and Working With Other Students and Homework • For 
example, a coefficient was computed using six Confidence 
statements - three from the During Class setting and three 
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from the Homework setting. Similarly, the reliability 
estimates were computed using stateirents from both the 
During Class and Working With Other Students settings, and 
the Working With Other Students setting and Homework 
setting Finally, the coefficient alpha reliabilities were 
also computed for the total of nine statements written for a 
given construct combined across these settings • 

Table 4-11 presents the coefficient alpha reliabilities 
for statements combined for settings, A comparison was made 
of the coefficients for the pairs or total settings for 
which the value of the coefficients stayed the same 'within 
.01) or was lower than one of the individual settings 
coef ficicc^nts. Twelve of the 30 alphas for the combined 
pairs of settings are the same or lower than one of the 
individual cluster alphas, as are two of the alphas for all 
three settings combined (Interest and Internal Stable 
Uncontrollable) • The construct of Interest is not 
homogeneous when the settings are paired, nor are the 
constructs of External Performance Goals and three of the 
four attribution constructs (ISC, ISU, ESU) • 

Thus, including statements from more than one activity 
setting increases the coefficient in r/ome cases, decreases 
it in others, and makes no difference in others. These 
results may indicate an interaction between setting and 
affective beliefs, motivations and attributions. In seme 
cases, assessing the constructs in different settings 
provides additional information but the effect is not 
consistent for each setting. 

The coefficients alpha reliabilities based upon the 
nine items (combining the three settings) are generally 
higher than the coefficients based upon a single setting 
with three items. The coefficient alpha reliabilities based 
upon all settings appear to include variance which is unique 
to the construct, and common across the settings. With nine 
items, the reliability estimates would be expected to 
increase, regardless of the effect of the setting. Howev^.r, 
compared to the paired six item alphas, the increase was lot 
substantial, suggesting that variance associated witn the 
setting adds unique variance. Only in two cases. Value and 
Unknown Control, did the nine items have higher alphas than 
the six item pairs. 

Table 4-11 also presents the Spearman-Brown esti'^^^tes 
for individual settings acreasing the number of item^ to 
six - or four as with the Internal Learning Goals in the 
Homework setting. The Spearman Brown estimates were 
calculated to provide an indication of the theoretical 
ceiling for the alphas of the combined six item clusters. 
If there is variance unique to each cluster, the 
coefficients for the pairs should will be lower than the 
either of the Spearman-Brown estimates. 
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TABLE 4-11 

Coefficient Alpha Reliabilities for the Three Item Clusters 
Combined Across Activity Settings and 
Spearman-Brown (SB) Estimates for Individual Settings 

Activity Settings 

During Class During Class With Others All 3 
Psychological & & & Settings 

Construe ■ With Others Homework Homework Combined 



Value 

Alpha .614 .682 .640 .730 

SB .667-. 565 .667-. 651 .565-. 651 

Interest 

Alpha .497 .727 .678 .717 

SB .502-. 655 .502-. 841 .655-. 841 

Confidence 

Alpha .611 .745 .660 .752 

SB .708-. 583 ./08-.758 .583-. 758 

Anxiety 

Alpha .589 .674 .563 .682 

SB .731-.684 .731-. 622 .684-. 622 

Internal 
Learning Coals 

Alpha .794 o767 ^ .754 * .822 

SB .831-. 823 .831-. 849 .823-. 849 

External 

Performance Goals 

Alpha .471 .554 .652 .653 

SB .338-. 695 .338-. 704 .695-. 704 

Internal Stable 
Controllable 

Alpha .539 .750 .562 .670 

SB .766-. 758 .766-. 754 .758-. 754 

Internal Stable 
Uncontrollable 

Alpha .741 .368 .515 .604 

SB .744-. 766 .744-. 844 .766-. 844 
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TABLE 4-11 (continued) 

External Stable 
Uncontrollable 

Alpha ^604 ^592 .729 .715 

SB •590-.760 •590-»753 .760- •753 



Unknown Control 

Alpha ^717 •756 •737 .797 

SB •812-^740 •812-^ 796 • 740- • 796 

^ In the Homework setting, based upon a two item cluster • 



A comparison of the pair alphas and the Spearman-Brown 
estimates revealed that thirteen of the alphas of the pairs 
were within the range of the two Spearman-Brown estimates • 
Only one v/as higher — Value for the pair During Class and 
Homework^ However, thirteen of the pairs of coefficient 
alphas were lower than both Spearman-Brown estimates • This 
further suggests the unique contribution of the activity 
setting^ The majority of these pairs (10 of the 13) involve 
the Working With Other Students activity setting; seven 
involve During Class; and nine involve Homework^ 

Further analyses using multidimensional scaling and 
repeated measures multivariate analyses of variance, also 
substantiate the conclusion of variance specific to activity 
settings • Assessing the constructs in the context of an 
activity setting adds unique variance (Tittle & Hecht, 1990; 
Tittle, Weinberg & Hecht, 1990) • 

Comparisons by Grade Level 

Alpha reliability estimates were also computed for the 
seventh, eighth and ninth-grade students separately o These 
are presented in Tables 4-12 through 4-14. Examination of 
these coefficients indicates that some clusters are more 
reliable in one grade than nother^ However, there is no 
consistent pattern of increased cr decreased reliability for 
any particular grade • 

In general^ the absolute differences in the 
coefficients between any two grades are smalls Only four 
differences are greater than •lO, with only one greater than 
•20. The largest difference is between grades in response 
to statements concerning Anxisty while doing Homework^ 
Responses of the seventh-grade students were the least 
internally consistent (r=.305) while responses of the ninth 
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TABLE 4-12 



Coefficient Alpha Reliabilities by Grade for th' 
Psychological Constructs 
within the During Class Activity Setting 







Grade 


Level 




Psychological 
Construct 


7 

(N=442) 


8 

(N=482) 


9 

(N«434) 


Total 
(N-1358) 


Value 


.477 


.484 


.513 


.500 


Interest 


.295 


.346 


.344 


.335 


Confidence 


.455 


.585 


.597 


.548 


Anxiety 


.593 


.605 


.524 


.576 


Internal Learning 
Goals 


.711 


.692 


.7?.6 


.710 


External Performance 
Goals 


.166 


.168 


.281 


.203 


Internal Stable 
Controllable 


.650 


.633 


.567 


.620 


Internal Stable 
Uncontrollable 


.539 


.601 


.632 


.593 


External Stable 
Uncon tro 1 1 ab 1 e 


.429 


.436 


.382 


.418 


Unknown Control 


.639 


.707 


.703 


.683 
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TABLE 4-13 

Coefficient Alpha Reliabilities by Grade for the 

Psychological Constructs Within the 
Working With Other Students Activity Setting 



Grade Level 



Psychological 7 8 9 Total 

Construct (N=4rd) (N«447) (N«405) (N-1270) 



Value 


.403 


.352 


.419 


.394 


Interest 


.474 


.475 


.514 


.487 


Confidence 


.419 


.452 


.354 


.412 


Anxiety 


.518 


.507 


.535 


.520 


Internal Learning 
Goals 


.693 


.642 


.757 


.698 


External Performance 
Goals 


.554 


.533 


.506 


.532 


Internal Stable 
Controllable 


.585 


.611 


.638 


.610 


Internal Stable 
Uncontrollable 


.627 


.o47 


.580 


.620 


External Stable 
Uncontrollable 


.594 


.642 


.601 


.613 


Unknown Control 


.618 


.566 


.577 


.588 
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TABLE 4-14 

coefficient Alpha Reliabilities by Grade for the 
Psychological Coi>structs 
Within the Hriiework Activity Setting 



Grade Level 



Psychological 7 8 9 Total 

Construct (N«480) (N^/'.BS) (N«437) (N-1405) 



Value 


.437 


.484 


.534 


.483 


Interest 


.716 


.715 


.744 


.725 


Confidence 


.593 


.589 


.652 


.611 


Anxiety 


.305 


.480 


.564 


.451 


Internal^ 
'teaming Goals 


.708 


.710 


. /99 


.737 


jclxternal 

Performance Goals 


.524 


.602 


.493 


.543 


Inte^rnal stable 
Controllable 


.580 


.622 


.613 


.605 


Internal Stable 
Uncontrollable 


.708 


. 715 


.771 


.730 


External stable 
Uncontrollable 


.504 


.595 


,633 


.603 


Unknovm Control 


.676 


.658 


.640 


.661 



^ two item cluster 
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grade students were the wost consistent (r=»564). Based 
upon an examination of the reliability coefficients, it was 
decided that the three item clusters are not meaningfully or 
consistently more reliable or unreliable within one grade 
than another. 

Student Level Analyses 

Several data analyses were performed to examine student 
level responses to the Mathematics Assessment Questionnaire 
statements. These analyses examined the dimensionality of 
the various constructs using factor analyses and 
discriminant function analyses. In the following discussion 
the analyses are grouped according to the construe c 
examined. 

Metacognitive statements 

Factor Analysis; Four Factor Solution 

The 20 Metacognitive statements were subjected to a 
principal axis factor analysis with varimax rotation. 
Eigenvalues greater than 1 and a scree test were used as 
criteria to determine the number of factors to retain. 
Although the two, three, and four factor so'^utions were 
examined, the four factor solution )provided the most 
interpretable results from a theoreticax perspective. \hB 
four factor solution accounted for 22.3% of the variance. 
Table 4-15 presents the factor loadings following the 
orthogonal rotation. Although the factor loadings following 
the oblique rotation were also examined, the interpretations 
based upon both rotations were similar. 

Factor loadings greater than .30 were examined to help 
interpret the factors. These loadings are in bold face in 
Table 4-15. The four factors can be roughly characterized 
as grouping together general problem-solving approaches and 
problem-solving strategies, as well as processing activities 
that occur before, during and after solving the nonroutine 
mathematical word problem used in the Mathematics Assessment 
Questionnaire. 

Awareness of general problem solving approaches and 
strategies : The first factor includes statements or 
prompts concerning general approaches and problem- 
solving strategies. It includes a general statement, 
"I felt confused and could not decide what to do." The 
statement, "I drew a picture to help me understand the 
problem," has a negative loading on this factor. This 
statement describes a "natural strategy" for the 
specific mathematical problem which the students 
worked. It seems to indicate that those students who 
used this strategy were effective problem-solvers: they 



ERLC 



8:i 



Technical Report 
IV - 26 



TABLE 4-15 

Factor Loadings for the Metacogni iive Statements: 
Four Factor Solution 

(N=1612) 

Factor Loadings 



Metacognitive I n m iv 

Statements 



20, I felt confused and could .615 .053 .015 -.041 

not decide what to do. 

18. I "guessed and checked." ,462 -.036 -.033 ,008 

4. I tried to remember if I ,364 .029 -.008 .284 

had worked a problem like 
this before. 

16. I thought about a different ,330 -.022 .046 .160 
way to solve the problem. 

12. J looked back tc see if I -.076 .589 .107 .123 
did the correct procedures. 

13. I checked to see if my --.104 •564 .045 .146 
calculations were correct. 

14. I went b' 'c and checked my .086 ,547 .141 .079 
work again. 

11. I checked my work step-by -.087 ,465 .217 .206 
step as I worked the 
problem. 

15. I looked back at the probleij .123 .307 -.014 .310 
to see if my answer made 

sense. 

9. I kept looking back at the -.006 .120 .459 .040 
problem after I did a step. 

10. I had to stop and rethink a .303 .060 .384 .034 
step I had already done. 

17. I drew a picture to help me -.347 -.002 .368 -.158 
understand the problem. 



b-1 



MAQ Technical Report 
IV - 27 

TABLE 4-15 (Continued) 

19. I picked out the operations .065 .131 -.005 •47r; 
I needed to do this problem. 

6. I asked myself, Is there -107 .044 .027 .371 
information in the problem 

that I don't need? 

5. I thought about what -.056 .209 .066 .360 

information I needed to 
solve this problem. 

8. I thought aLout all the -.031 .197 .195 .321 

rteps as I worked the 
problem. 

1. I reaci the problem more .041 .173 . 254 .042 
than once. 

2. I thought to myself, Do I .023 .139 .141 .191 
understand what the question 

is asking me? 

3. T tried to put the problem .181 .034 -.0J\ .242 
into my own words. 

7. I wrote down importr -.192 .044 .274 .188 
information. 



Bold type indicates lo'^dings above .30. 
Percentage of variance accounted for: 22.3% 



were clear that they did not use "guess and check" r^r 
were they confused when working the problem. 

Awa reness of checking activities ? Statements with 
loadings greater than .30 on the second factor foous 
upon checking activities engaged in after and during 
working the problem. Examples of statements are, "I 
looked back to see if I did the correct procedures," 
and "I checked my work step by step as I did the 
problem. " 

A wareness of monitoring activities : The third factor 
i.icludes statements related to inonitoring activities 
eagaged in during the working of the problem. An 
example is, "I kept looking back at the problem after I 
did a step. " 
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Awarenes s of planning ac tivities ; Statements included 
on the fourth factor focus upon planning activities in 
preparation for problem-solving. Examples are, "i 
thought about: ^/hat information I needed to solve this 
problem," and "I picked out the operations I needed to 
do this problem." These statements may cluster here 
since they tend to be less applicable to the particuia>- 
nc:irout-ine problem used in the MAQ. 

Four prompts did not have loadings greater than .30 on 
any of the four factors: 1) "I read the problem more than 
once;" 2) "I thought to myself, Do I understand what the 
problem is asking me?" 3) "I tried to put t.ie problem into 
my own words," and 4) wrote down important information." 
The fir&t statement had a v^ry high percentage of "yes" 
responses, and therefore less variance. Even tJiough the 
statements had been reviewed with students during individual 
interviews, the second and third statements may not be 
meaningful to students given the specific problem solved. 
Although the fourth statement "I wrote down important 
information," did not have an" loading above .30, its 
highest loading, .27, as expedited, was on the monitoring 
activities factor. 

It is likely that the pattern of meaningful loadings 
for the Metacognitive statements would shift as a function 
of the task requirements. In particular, if studer*cs solve 
a word problem which is dependent upon knowledge of a 
specific mathematical topic, different clusters might be 
obtained depending upon the mathematical experiences of the 
stud lints. 

Factor Analysis; Two Factor So?ntion 

Although the four factor solution was the most 
meaningful from a theoretical perspective, from an empirical 
perspective the two factor solution can hv useful. The 
first four eigenvalues based upon the common factor model 
were: 2.15, 1.29, .584, and .440. Thus, ur^.ng the scree 
test as a guide, the two factor model is more appropriate or 
useful. The two factor solution accounted for 16.7% of the 
variance. 

Table 4-16 presents the factor loadings based rpon the 
two factor model. Examination of factor loadings greater 
than .30 suggests that the two factors which <iiuerged are 
similar to the first two factors which were found (in 
rferse order) based upon the four factor solution. 

Awareness of monitoring and checkinr of the problem- 
solving process : The first fr.ctor includes statements 
with loadings greater than .30 which focus upon 
monitoring and checking activities engaged in during 
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lABLE 4-16 

Factor Loadings for the Metacognitive Statements: 
Two Factor Solution 



(N=i612) 



Metacognitive 
Statements 



Factor Loadings 



II 



11* I checked my work step-by-step .5f5 -.037 

as I worked the probl^in. 

12. I looked back to see if I did .5^0 -.047 

the correct procedures. 

''3. I checked to see if my .532 -.055 

calculations were correct. 

14. I went back and checked my work .492 .077 
again. 

8. I thought about all the steps .385 .073 
as I worked the problem. 

15. I looked back at the problem j .367 .229 
see of my answer made sense. 

5. I thought about what information .366 .078 

I needed to solve the problem. 

19 I picked out the operations I needed .310 .231 
to do this problem. 

9. I kept looking back at the problem .269 -.035 
after I did a step. 

2. I thought to myself, Do I understand .251 .079 
what the problem is asking me? 

7. I wrote down inportant information. .248 -.123 

1. I read the problem moro than once. .244 .021 

20. I felt confused and could not -.135 .515 

decide what to do. 

4. I tried to remember if I had »105 .455 

worked a problem like this before. 
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TABLE 4-16 (Continued) 

18 • I "guessed and checked." -.103 .430 

17. I drew a picture to help me .102 -.388 

understand the problem. 

16. I thought about a different .029 .369 

w^Y solve the problem. 

J. I tried to put the problem into .117 .264 

my own words. 

6- I asked myself, Is there infonuation .205 .237 
in this problem that I don't need? 

10. I had to stop and rethink a step I .155 .226 
had already done. 

Bold type indicates loadings above . 30 
Percentage of variance accounted for: 16.7% 



and after working cl>^ problem^ Examples of statements 
are "I looked back to see if I die the correct 
procedures," and "I checked my work step by step as I 
did the problem." 

Awareness of general problem solving approaches and 
strategies ; The second factor includes the statements 
"I felt confused and could not decide what to do" as 
well as the statement, "I guessed and checked." There 
is a negative weight for "I drew a picture to help me 
understand the problem," a natural stratejy for the 
nonroutine problem which students worked. This bipolar 
factor appears to inqica'ce awareness of and successful 
problem solving strategies versus confusion and 
unsuccessful problem solving strategies. 

Factor Analysis of Subgroups - Sex and Achievement 

To help further examine the factor structure of the MAQ 
Metacognitive statements, severol additional factor analyses 
were performed. The 20 items were factor analyzed along 
with the indicators of mathematics achievement (MAT) and 
reading achievement (DRP) . 

The 20 Metacognitive statements and the national 
percentile rank scores on the Metropolitan Achievement Test 
were factor analyzed. Due to missing MAT national 
percentiles,^ the sample for this analyris w?s 1402 students. 
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The two factor solution accounted for 16.7% of the variance. 
Although the factor loadings following both the orthogonal 
and oblique rotation were examined, tt i interpretations were 
almost identical. The national percentile on the MAT had a 
negative loading of -.417 on the bipolar factor (Factor 2, 
page 29) which assessed general problem-solving approaches 
and strategies. TLe item "I drew a picture to help me 
understand the problem," also had a negative loading on this 
factor. 

The indicator of reading achievement, the national 
percentile on the Degrees of Reading Power , was also factor 
analyzed with the Metacognitive statements. The sample size 
for this analysis was 1391. The two factor solution, which 
accounted for 16»5% of the variance, was similar to that 
obtained when the MAT was included in the analysis. The DRP 
national perce»^*^ile hai a negative loading of -.440 on the 
factor which a^-^essed strategies and problem solving 
approaches. Thus, higher scores on both the math and 
reading tests were not associated with responses indicating 
perceptions of confusion about the problem solving process. 

To help assess whether the factor structures differed 
for different subgroups of the sample, a series of factor 
analyses were performed. Specifically, the factor 
structures of the following subgroups were examined: boys, 
girls, low mathematics achieving students, and 
high mathematics achieving students. (Classification 
procedures for identifying the high and low achievers are 
described on page IV-4 . } 

The factor structure based upon the responses of 710 
male students was nearly identical to the str^icture based 
upon the responses of 895 female students. The two factor 
solution accounted for 15.9% of the variance in the boys' 
responses and 17,8% of the variance in the girls' responses. 
Similar factor structures were also found based upon 
separate factor analyses of responses of the 427 high and 
415 low achievers. The two factor solution accounted for 
17.7% of tha variance among responses of the high achievers 
and 14.9% of the variance among responses of the low 
achievers. Overall, the factor analyses of the subgroups 
were similar to the factor analyse.*^ of the Total Data 
Analysis Sample. 



Discriminant Analyses 



I 



ERIC 



A discriminant analysis was used to examine whether 
student responseis to the 20 Metacognitive statements would 
discriminate among four groups: high achieving boys, low 
achieving boys, high acnieving girls and low achiev** "^g 
girls. In these analyses high achievers were defined as 
students who fell within the top 30% of the sample on the 
MAT national percentiles. There were 206, 182, 220, and 233 
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students within each of the four groups, respectively. 

Two discriminant functions accurately classified 44% of 
the students in the four groups (X^(69) = 343.98, 
p < .0001). After removal of the first funcj^ion, the second 
function further discriminated the groups (X^(44) = 101.82, 
p < .0001). The means of the groups on the first 
discriminant function revealed that it separated high and 
low achievers. The second function discriminated between 
boys and girls. To interpret the discriminant function the 
correlations between the Metacognitive statements and wiie 
discriminant functions were examined. Correlations greater 
than .30 were considered meaningful and used to characterize 
the functions. 

The first function indicated that low achievers: did 
not draw a picture (-.68); felt confused (.49); thought of a 
different way to solve the problem (.40); had to stop and 
rethink a step already done* (.34); put the problem into 
their own words (34); guessed and checked (.33); picked out 
the operations needed to work the problem (.31); and tried 
to remember if they had worked a problem like this before 
(.30). 

The second function discriminated between boys and 
girls. Girls more often than boys reported that: they went 
back and checked their work (.56); kept looking back (.55); 
stopped and rethought a step (.40); and read the problem 
more than onca (.33). 

Thus, the rerults of this analysis suggest that the 
statements which most discriminate high and low achievers 
are those which dea.T with problem-solving strategies. Low 
ac lievers a re confused about what strategies to use and how 
to use them. Checking behaviors appear to discriminate most 
between boys and c,irls, with girls reporting the^ are more 
likely to check their work. 

To further Investigate whether the low achievers or 
boys and girls are "confused," a second discriminant 
ana^/sis was performed. In addition to th& Metacognitive 
statements, an attribution construct. Unknown Control, was 
entered into the four group analysis. As an indicator of 
Unknown Control within each activity setting, responses to 
the three Unknown Control statements within each setting 
were "jummed. Unknown Control assesses ^ student's feeling 
of a 9^:neral lack of control or awareness concerning why he 
or she is successful or f<>ils. Witn the inclusion of the 
three indicators of Unknown Control (During Class, Working 
With Other Students and Homework) , the two discriminant 
functions correctly classified 49% of the caseis in the four 
groups. As expected, the three indicators of Unknown 
Control helped to discriminate botw^^en the high and low 
achievers. Low achi. ers perceived less of a sense of 
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I control in all settings. 

^ The Unknown Control construct as assessed within the 

I Working with Othf^.r students setting was also correlated 

• above .30 on the second function. Eoys felt less of a sense 
of control within the group setting than girls. 

I Self -Regulatory statements 

m A principal axis factor analysis of all the Self- 

I Regulatory statements, combined across settings, was 

performed. That is, statements in the During Class, Working 

With Other Students and Homework settings were analyzed as 
I one set. Eigenvalues greater than 1 and a scree test were 

I used as a criterion to determine the number of factors to 

retain. The three factor solution, based upon an orthogonal 
M rotation, provided the most interpretable results. The 

I results indicated that statements dealing with Self- 

Regulation while Working With Other Students are a distinct 
_ dimension from thi During Class and Homework statements. 

I The latter two settings are not as clearly discriminated 

• from one another, but do not form one factor or dimension. 

■ Since this overall factor analysis indicated that the 
I types of self -regulatory behaviors exhibited within the 

three settings are somewhat distinct, responses from each 
mm setting we>-e examined separately. Separate principal factor 

■ analyses were performed to help investigate the underlying 
structure of the responses to the statements within 
individual settings. The three analyses are discussed 

I below. 

Factor analysis - During c lass 

I The 19 statements assessing self -regulatory behaviors 

During Class were subjected to a principal axis factor 
— analysis. Based upon a scree test and examination of the 

■ eigenvalues greater than 1, the three factor solution was 

■ rev^ined. The three factor solution accounted for 
approximately 32.2% of the cotmon factor variance. To help 

■ interpret the three factors, -che solution was orthogonally 

■ rotated and the factor loadings examined. Table 4-17 
pres'^ints the statements and factor loadings. Factor 

m loadings greater than .30 were accepted as meaningful and 

■ used to represent the factors. The three factors may be 
characterized as follows: 

I Awareness of self-responsibility for learning ; The 11 

™ statements with loadings on this first factor address 

what a student actively does During Class to help 

■ learn. The statements focus upon activities which the 
I student engages in by her or himself. For example, "1 

review the xvord prr'^lems my teacher did," and "I make 

I 
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TABLE 4-17 

Factor Loadings for t^3 Self -Regulatory statements 
in the During class Activity Setting 

(N=1628) 



Factor Loadings 

Self -Regulatory 

Statements I II III 



1. I get ready to listen .634 .012 .060 
carefully. 

16. I try to figure out of I .628 .126 .110 
need to do more to learn 

rhe lesson. 

15- I ask myself if I understand .625 >171 .094 

the lesson. 

18. I review the word problems .614 .061 .160 
my tc^acher did. 

3. I make sure I am paying .580 .052 .095 

attention . 

19. When I review word problems .565 .174 .191 
from class, I evaluate if I 

understood the lesson. 

17. I decide if I need to ask .533 .131 .409 
the teacher a question about 

the lesson. 

7. I think about what is import- .526 .122 .027 

ant to learn in the lesson. 

2. I make s.ire I have all the .462 .095 .063 
materials I need. 

10. I think about whether I .349 .218 .191 

understand an example the 
teacher puts on the board. 

9. I think of an answer to a .313 .274 .142 

question the teacher is 
asking. 
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TABLE 4-17 (continued) 

5. I know when* the teacher is .013 .612 •108 

beginning a new math idea* 

6* I know when the teacher is .121 .550 .062 

giving me practice in new 
math problems. 

4* I know when the teacher is .016 .476 .075 

reviewing materials already 
taught . 

14. I know when the teacher is .142 .373 .085 

about to end the lesson or 
topic. 

8. I know what the teacher is .177 .344 .094 

going to do next in the 
lesson. 

12. I ask my teacher to explain .251 .026 .653 
a problem again that I do 

not understand. 

11. When my teacher makes a .065 .163 .500 

mistake, I say something 
about the error. 

13. When I can think of another .092 .196 .498 
way to solve a word problem, 

I volunteer to show the class. 

Bold type indicates loadings above .20 
Percentage of variance accounted for: 32.2% 



sure I am paying attention."" Statements from each of 
the three categories, before, during and after loaded 
on this factor. 

Awareness of teacher ^s lesson structure : The second 
factor included five statements with leadings above 
.30. These statements assess student awareness of the 
teacher's structure during \ mathematics lesson. 
Statements with meaningful loadings on this factor 
include, "I know when the teacher is giving me practice 
in new math problems," and, "I know when the teacher is 
about to end the lesson or topic." 

Active pc\rticipation in classroom activities : The final 
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factor includes four statements with loadings above 
.30, These address the studentr' active participation 
in classroom lessons* The four include stat-^ments 
which indicate that the student interacts with the 
teach' r and is willing to participate in front of other 
students. Examples of stat-emer '-s are, "When my math 
teacher makes a mistake I say something about the 
error," and "I ask my teacher to explain a problem 
again that I do not understand •" 

In, order to assess the internal consistency of 
students' responses to statements with loadings above ,30 on 
each factor, alpha reliability coefficients were computed* 
All statements with loadings above ,30 were included within 
each ana/.ysis. The obtained values were .84, •60, and •65 
respectively for the three factors • 

Factor A nalysis ■ Working With Other Students 

The twenty-three Self-Regulatory statements written for 
the Working With Other Students setting were subjected to a 
principal axis factor analysis • A scree test and 
examination of the eigenvalues indicated that the three 
factor solution, accounting for 43^2% of the variance, could 
be used to i apressnt the data^ The three factor solution 
was orthogonally rotated and the factor loadings above ^30 
examined to characterize the factors • Tablr 4-18 displays 
the statetnents and factor loadings • The three lactors can 
be described as follows: 

Active engagement in the group durinv. problem-solving: 
The first factor includes 14 of the 23 items • The 
factor has statements focused on the student's 
interactions with others in the group about doing the 
word problem^ statements with high loadings are, "I 
say to the other students what information we need to 
use to work the problem," and "I talk to the other 
students abou^ how other problems are like the one we 
are working on^" 

Individual monitoring and checking directed toward 
problem-solving t The second factor includes 12 
statements with loadings above ^30^ They assess 
activities students engage in individually to make the 
group work and to solve the problem, with the focus on 
monitoring and checking activities • These are 
activities independent of the group activities, focused 
upon solving the problem. Examples are, "I look over 
all the work we did to see if we used the right 
procedures," and "I check to see if our calculations 
are right." 
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TABLE 4-18 

I actor Loadings for Self -Regulatory Statement?; 
in the Working With Other Students Activity Setting 
(N=^1538; 



Factor Loadings 

Self -Regulatory 

Sta ^ents I II III 



6, I say to the other stu^^nts .730 .197 .130 

what I think we should do first* 

/• I say to the other students .728 .232 .156 

what information we need to 
use to work the problem • 

4» I say to the other students .656 .239 .169 

what I think the problem 
is asking* 

8* I say to the other students .622 .229 .201 

if I think something should 
be worked differently* 

5* I say to the other students .616 .177 .093 

how the problem is like other 
problems I have worked. 

9. I talk to the other students .596 .248 .098 

about how other problems are 
like the one we are working on. 

11. I explain to the other students .565 .278 .171 
why I think my answer or 

procedure is right. 

20. I say to the other students .515 .444 .150 

wheth' r I think the answer 
makes sense. 

12. I encourage the other students .304 .460 .092 
to work on the problem too* 

10. I ask the other students .418 .302 .038 

questions:* about the problem. 

3. I think about how long ic .366 .199 •14<? 

will take us so ve can 
plan our time^ 
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TA^LE 4-18 (continued) 

17. I look over all the work we .254 .653 .209 
did to see if we used the 

right procedures. 

18. I check ':o see of our .217 .6^6 .247 
calculations arc right. 

13. I listen carefully to what .238 .595 .204 
everyone says about the 

problem. 

16. We check each other's ideas. .367 .570 .106 

14. I keep looking back at the .204 .552 .271 
problem to make certain we are 

doing what we need to do. 

19. I ask the other students .472 .519 .085 
whether anyone thinks the 

answer is wrong. 

15. I keep trajk of what everyone .190 .494 .164 
says. 

21. I ask the other students if .479 .486 .113 
anyone has a different way 

to solve the problem. 

1. I make ^u^e I have all the .197 .365 .151 
material ^ I will need. 

23. I know if I will be able to .119 .188 .70d 

solve word problems like this. 

22. I know if I learned ways to .134 .225 . -S68 
do the word problem. 

2. I try to work the problem .166 .2 85 .303 
by myself first. 



Bold type indicates loadings above .30 
Percentage of variance accounted for: 43.2% 



Self-monitoring of understand5 na or self-evaluation i 
The final factor includes 3 statements which i^ssess 
what a student feels he or she understands fro^ the 
experiences of working the problfeifl in the jroup 
setting. It includes monitoring aspects oS self- 
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ev< ' uation* For example, "I know if I learned ways to 
do the word problem/^ and "I know if I will be able to 
solve a word problem like this." 

In order to help assess the strength of the association 
among statements within each factor, the internal 
consistency was estimated using coefficient alpha. The 
estimates were .91, .88 and .62 for the three factors, 
respectively. 

Factor Analysis - Homework 

The Homework setting included nine statements written to 
assess self -regulatory behaviors. Student >asponses to 
these nine statements were sxibjected to a principal axis 
factor analysis. The three factor solution, which accounted 
for approximately 41.2% of the variance, was rotated 
orthogonally. The factor analysis of the Homework 
statements revealed a factor structure which resembled the 
structure used to write the statements, that is, planning, 
monitoring and checking. Table 4-19 displays the statements 
and factor loadings. 

Monitoring proare^is: The four statements with factor 
loadings above .30 on factor one include statements 
concerning a student's monitoring of her or his 
progress during working homework problems. An example 
is, "I keep track of my work as I am doing a homework 
word problem. " 

Sfelf -responsibility and checking : Four statements 
loaded above .30 on the second factor. These 
statements include activities related to a student's 
S'alf -responsibility for reviewing the homework, both 
alone and In preparation for school. An example, is, 
"If I cam»Dt do the word problems, I write out all the 
steps I can do and bring them to class. ^ 

Time management and Planning; The two statements with 
loading above .30 on factor three are statements which 
focus upon the student's time management and 
preparation before doing the homework. The two items 
are "I decide when is the best time to do my math 
homework word problems, and "I decide how much time to 
spend on my math homework v/ord problems." 

The internal consistency of responses to statements 
with loadings above .30 on each of the three factors was 
estimated using coefficient alpha. The estimates were .74, 
.63 and .57 for the three factors, respectively. 
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TABLE 4-19 

Factor Loadings for the Self -Regulatory Statements 
in the Homework Activity Setting 

(N=1679) 



Factor Loadings 



Sel f -Regulatory 



statements 


I 


II 


III 


4. 


I read each problem carefully. 


.763 


.172 


.058 


5. 


I keep track of my work as I 

am doing a homework word problem. 


.697 


.208 


.085 


6. 


I make sure I try every problem, 
even if I cannot solve them all. 


.536 


.265 


.019 


3 . 


I make sure I have all the 
materials I need. 


.424 


.314 


.222 


7. 


If I cannot do the word 
problems, I write out all the 
steps I can do and bring them 
to class. 


.175 


.655 


.049 


9. 


I review my homework word 
problems before class. 


.188 


.493 


.198 


8. 


If I do not understand the 
homework word problems, I csk 
the teacher to explain them. 


.293 


.432 


-.030 


2. 


I decide how much tine to 
spend on my math homework 
word problems. 


.018 


.100 


.637 


1. 


I decide when is the best time 
to do my math homework word 
problems . 


.135 


.033 


.622 



Bold type indicates* loadings above .30 



Percentage of variance accounted fov; 41.2% 
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Aff«otiv« Bali«fs# Motivations and Attributions 

Means and Standard Deviation s 

The means and standard deviations of items summed for 
each psychological construct within each setting were 
examined. Prior to stanming, the scoring on negatively 
worded items was reversed. The summed scores are displayed 
in Tables 4-20 through 4-22 for the During Class, Working 
With Other Students, and Homework settings, respectively. 

The summed scores can range from 3 to 15 for all 
clusters with the exception of the two-item dusts'* for 
Internal Learning Goals in the Homework activity setting. 
To compare means for the Internal Learning Goals in all 
settings, the mean for Homework was estimated using the 
information from the two item cluster. Responses to the two 
items were averaged, and then this average multiplied by 
three. 

As displayed in Tables 4-20 through to 4-22 lower 
scores indicate more of the construct. For example, in 
Table 4-20, During Class, the lower mean for Confidence 
(6.86) indicates more confidence and the higher mean for 
anxiety (10.14) indicates less anxiety, on the average. 

Differences Across Settings 

Table 4-23 presents the means, standard deviations, and 
results of the repeated measures multivariate analysis of 
variance. This analysis permits examination of differences 
in means for each construct across the three settings. 
These means differ from those reported in Tables 4-20 to 
4-22 since only students with complete responses across all 
three activity settings could be included in Table 4-23. 

As inspection of the means indicates, the differences 
are small but significant, given the large sample size. 
Table 4-23 also includes a summary of the differences among 
the three means, as defined by the confidence intervals for 
the means. For example, for Value, the mean in the setting 
of Working With Other Students is significantly different 
from the mran responses for During class and Homework, but 
the latter two means are not different. For Interest, all 
three means are significantly different. Since the 
variables are coded so that a higher number indicates LESS 
of an interest, students are indicating the greatest 
interest in working on solving mathematical word problems in 
the group setting, then in class, then in homework. For the 
group setting, items are, "I think it would be interesting 
to work on a math word problem with other students," "I 
would find math interesting if I worked on a word problem 
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TABLE 4-20 

Mean, Standard Deviation, Variance, Skevness, and Range 
of Summed Psychological Cons?truct Scores 
in the During Class Acti^ ity Setting 



Psychological 

Construct Mean SD Variance Skewness Range N 



Value 


7.37 


2 


.61 


6.80 


.40 


3-15 


1686 


Interest 


8.49 


2 


.63 


6.89 


.20 


3-15 


1688 


Confidence 


6.86 


2 


.46 


6.03 


.42 


3-15 


1688 


Anxiety 


10.14 


3 


.03 


9.20 


-.39 


3-15 


1683 


Internal 
Learning 
Goals 


7.67 


2 


.79 


7.81 


.22 


3-15 


1705 


External 

Performance 

Goals 


8.78 


2 


.27 


5.13 


.05 


3-15 


1656 


Internal 
Stable 

Controllable 


7.14 


2 


.46 


6.07 


.41 


3-15 


1693 


Internal 7.99 
Stable 

Uncontrollable 


2 


.62 


6.88 


.17 


3-15 


1674 


External 9.86 
Stable 

Uncontrollable 


2 


.59 


6.72 


-.22 


3-15 


1678 


Unknown 


11.65 


2 


.84 


8.04 


-.69 


3-15 


1654 



Control 
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TABLE 4-21 

Mean, Standard Deviation, Variance, Skewness, and Range 
of Siuamed Psychological Construct Scores 
in the Working With Other Students Activity Setting 



Psychological 

Construct Mean SD Variance Skewness Range N 



va j.ue 




2 




o . 


71 


. 09 


3-15 


1666 


Interest 


7.82 


2 


.61 


6. 


79 


.30 


3-15 


1661 


uonr xaence 


O . o / 






D m 




. 40 


3 — 15 


1673 


Anxiety 


10.99 


2 


.62 


6. 


87 


-.53 


3-15 


1667 


Internal 
Learning 
Goals 


7.50 




O 1 


/ . 


87 


. 50 


3—15 


v~ >■ ^ 

it)65 


External 

Perfdrmance 

Goals 


10.83 


2 


.73 


7. 


44 


-.34 


3-15 


1674 


Internal 
Stable 

Controllable 


9.63 


2 


.88 


8. 


27 


-.14 


3-15 


1659 


Internal 
Stabls 

Uncontrollabl 


8.52 

O 


2 


.65 


7. 


04 


.19 


3-15 


:636 


External 10.61 
Stable 

Uncontrollable 


2 


.60 


6. 


78 


-.25 


3-15 


1676 


Unlcnown 
Control 


11.16 


2 


.68 


7. 


17 


-.57 


3-15 


1634 



ERIC 



101 



MAQ Technical Report 
IV 44 



TABLE 4-22 

Mean, Standard Deviation, Variance, Skewness, and Range 
of Siumned Psychological construct Scores 
in the Homework Activity Setting 



Psychological 

Construct Mean SD Variance Skevmess Range N 



Value 


i 


.40 


2 


.67 


7.11 


.31 


3-15 


1671 


Intere;st 


9 


.60 


3 


.09 


9.56 


-.06 


3-15 


1690 


Confidence 


6 


.46 


2 


.59 


6. 68 


.59 


3-15 


1695 


Anxiety 


10 


.70 


2 


.61 


6.82 


-.37 


3-15 


1689 


Internal 
Learning 
Goals 


8 


.56 


3 


.44 


11,80 


.15 


3-15 


1700 


External 

Performance 

Goals 


8 


.64 


2 


.95 


8.72 


.16 


3-15 


1675 


Internal 
Stable 

Controllable 


7 


.34 


2 


.43 


5.88 


.25 


3-15 


1668 


Internal 12 
Stable 

Uncontrollable 


.17 


2 


.74 


7.51 


-1.03 


3-15 


1697 


External 10 
Stable 

Uncontrollable 


.45 


2 


.66 


7.09 


-.37 


3-15 


1674 


Unknovm 
Control 


11 


.04 


2 


.77 


7.69 


-.50 


3-15 


1680 
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TABUS 4-23 ,| 

Means, Standard Deviations and Differences for the summed | 

Psychological Constructs as Indicated by Repeated Measures I 

Analyses Across Activity Settings 1 



Activity Setting 



Working 

During Class v?ith Others Homework 
Psychological 

Construct M SD M SD M SD Sig^ 



Value 


7.39 


2 


.60 


8. 


18 


2. 


40 


7.36 


2 


.66 


D,H<WO 


Interest 


8.48 


2 


.64 


7. 


82 


2. 


62 


9.57 


3 


.08 


WO<D<H 


Confidence 


6.84 


2 


.45 


6. 


84 


2. 


28 


6.47 


2 


.5J 


H<D,WO 


Anxiety 


10.13 


3 


.04 


11. 


00 


2. 


61 


10.70 


2 


.62 


D<H<WO 


Internal 
Learning 
Goals 


7.66 


2 


.80 


7. 


49 


2. 


81 


8.52 


3 


.42 


WO,D<H 


Exteirnal 

Performance 

Goals 


8.78 


2 


.26 


10. 


84 


2. 


73 


8.65 


2 


.95 


D,H<WO 


Internal 7.12 
Stable 

Controllable 


2 


.47 


9. 


64 


2. 


87 


7.33 




.42 


D,H<WO 


Internal 8.00 
stable 

Uncontrollable 


2 


.60 


8. 


50 


2. 


64 


12.15 


2 


.74 


D<WO<H 


External 9.85 
Stable 

Uncontrollable 


2 


.59 


10. 


62 


2. 


60 


10.44 


2 


.66 


D<WO,H 


Unknown 
Control 


11.66 


2 


.84 


11. 


17 


2. 


67 


11.06 


2 


.75 


WO,H<D 



statistically significant differences Wilks Lambda p<.0001 
D - During Class; WO - With Others? H - Homework 
Arrows indicate direction of differences, commas indicate no 
difference N-==1600 
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with a group of students," and "Word problems would not be 
interesting to me if I did them with a group of students." 

Overall, the results of the repeated measures analyr.es 
show that the means for three constructs differ for each of 
the three settings: Interest, Anxiety, and the attribution, 
Internal Stable Controllable. The means of the remaining 
seven constructs differ in at least one setting from the 
other two settings. For individuals, as the repeated 
measures analysis indicates, settings do make a difference 
in responses to this set of affective beliefs, motivations 
and attributions. The data have also been analyzed using a 

3- way multidimensional scaling procedure (SINDSCAL) and 
yield the same conclusion: the salience of student's 
reported affective beliefs, attributions and motivations 
varies as a function of classroom-related activity settings 
(Tittle, Weinberg, & Hecht, 1990). 

Pearson Correlations 

Pearson correlations among the ten constructs within 
each setting were examined. These are presented in Table 

4- 24. The pattern of correlations greater than .30 within 
each setting differed. Within all three settings, the most 
consistent correlation was the negative relationship between 
Anxiety and Confidence. 

One attribution. Internal Stable Uncontrollable, was 
positively related to Confidence in the During Class setting 
(r=.35) and the Working With Other Students settings 
(r=.38), but negatively correlated within the Homework 
setting (r=-.59). The construct includes the belief that 
success or failure is due to "uncontrollable" factors, such 
as ability or mathematical aptitude. Examination of the 
statements suggests that they may be interpreted differently 
within each setting. In the During Class setting and 
Working With Other Students setting, the Internal Stable 
Uncontrollable statements focus upon attributions for 
successful problem-solving. For example, "If I can follow 
my teacher's explanation for word problems, it is because I 
am smart," (Daring Class) and "If I solve a word problem 
with other students, it is because we have enough ability* 
(Working With other Students) . In contrast the Internal 
Stable Uncontrollable statements within the Homework setting 
focus upon attributions for failure. For example, "If I 
cannot do math homework word problem, it is because I am not 
smart enough." This finding implies that students are 
responding to the "ability" component of the construct, 
rather than the "attribution" component. 

On the other hand, the correlations between the 
Internal Stable Uncontrollable construct and the External 
Stable Uncontrollable construct within each setting were 
positive (During Class .16, Working With Other Students .24, 
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TABLE 4-24 

Pearson Correlations Among the Svumed Psychological Constructs 
With Achievement Scores Within Settings 



During Class (N's range from 1619 to 1672) 



VAL 


INT 


CON 


ANX 


ILG 


EPG 


ISC 


ISU 


ESU 


UK 


VAL 1 


.00 




















INT 


.36 


1.00 


















CON 


.26 


.30 


1.00 
















ANX - 


.20 


-.25 


-.51 


1.00 














ILG 


.47 


.40 


.19 


-.19 


1.00 












EPG - 


.04 


.05 


.05 


.01 


.14 


1.00 










ISC 


.41 


.32 


.21 


-.12 


.55 


.19 


1.00 








ISU 


.20 


.24 


.35 


-.25 


.28 


.24 


.32 


1.00 






ESU 


.07 


.06 


-.20 


.16 


.15 


.18 


.20 


.16 


1.00 




UK 


.22 


-.24 


-.56 


.47 


-.11 


.10 


-.10 


-.18 


.33 


1*00 


MATSS 


.07 


-.05 


-.29 


.19 


.10 


-.02 


.10 


-.16 


.23 


.28 


MATNP 


.03 


-.06 


-.29 


.19 


.07 


.01 


.06 


-.17 


.20 


.28 


DRPSS 


.12 


.06 


-.19 


.10 


.14 


.01 


.14 


-.02 


.23 


.23 


DRPN? 


.05 


.03 


-.23 


.12 


.10 


.05 


.11 


-.05 


.21 


.27 



Working With Other Students (N's range from 1585 to 1634) 



VAL 


INT 


CON 


ANX 


ILG 


EPG 


ISC 


ISU 


ESU 


UK 


VAL 1 


.00 




















INT 


.55 


1.00 


















CON 


.37 


.37 


l.CO 
















ANX - 


.33 


-.45 


-.51 


1.00 














ILG 


.58 


.57 


.42 


-.34 


1.00 












EPG - 


.17 


-.24 


-.19 


.41 


-.14 


1.00 










ISC 


.07 


.08 


.01 


.14 


.11 


.30 


1.00 








ISU 


.34 


.26 


.38 


-.12 


.41 


.12 


.20 


1.00 






ESU 


.04 


.06 


-.06 


.19 


.09 


.42 


.35 


.24 


1.00 




UK 


.07 


-.07 


-.23 


.34 


-.03 


.46 


.38 


.08 


.49 


1.00 


MATSS 


.08 


.07 


-. 18 


.14 


.00 


.13 


.07 


-.03 


.10 


.23 


MATNP 


.04 


.06 


-.15 


.11 


.00 


.13 


.08 


-.05 


.12 


.23 


DRPSS 


.07 


.05 


-.16 


.15 


.02 


.13 


.10 


.00 


.14 


.25 


DRPNP 


.04 


.03 


-.14 


.13 


.01 


.15 


.10 


-.02 


.17 


.25 
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TABLE 4-24 (continued) 
Doing Homework (N's range from 1615 to 1665) 



VAL 


INT 


CON 


ANX 


ILG 


EPG 


ISC 


ISU 


ESU 


UK 


ViiJj 


1 n n 




















TUT 


• 4 / 


1.00 


















CON 


.36 


.27 


1.00 
















ANX 


-.16 


-.22 


-.45 


1.00 














ILG 


.36 


.63 


.30 


-.28 


1.00 












EPG 


-.32 


-.32 


-.16 


.00 


-.17 


1.00 










ISC 


.37 


.42 


.29 


-.25 


.47 


-.05 


l.'^O 








ISU 


-.31 


-.06 


-.59 


.32 


-.06 


.16 


-.15 


1.00 






ESU 


-.26 


-.14 


-.50 


.32 


-. 11 


.25 


-.06 


.56 


1.00 




UK 


-.29 


-.06 


-.50 


.29 


-.03 


.24 


-.11 


.61 


.55 


1.00 


MATSS 


.02 


.06 


-.20 


.21 


-.01 


-.10 


.09 


.23 


.17 


.21 


MATNP 


-.01 


.04 


-.21 


.18 


-.02 


-.07 


.04 


.25 


.20 


.23 


DRPSS 


.00 


.13 


-.17 


.13 


.08 


-.05 


.07 


.21 


.14 


.22 


DRPNP 


-.02 


.08 


-.22 


.14 


.04 


-.02 


.07 


.24 


.18 


.23 



Note : N'S Vary due to missing data being deleted pairwise) 

^ Psychological constiructs and achievement sco7.es are indicated as: 

VAL Value 

INT Interest 

CON Confidence 

ANX Anxiety 

ILG Internal Learning Goals 

EPG External Perfonaance Goals 

ISC Internal Stable Controllable 

ISU Internal Stable Uncontrollable 

ESU External Stable Uncontrollable 

UK Unknown Control 

MATSS Math\^matics Achievement Test - Scaled Score 

MATNP Mathematics Achievement Test National Percentile 

DRPSS Degrees of Reading Power - Scaled Score 

DRPNP Degrees of Reading Power - National Percentile 
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and Homework .56). This pattern suggests that students also 
respond to the "attribution" component of the statements. 

Examination of the correlations of the mathematics and 
reading achievement level (both scaled scores and national 
percentiles) with each construct revealed that no 
correlation exceeded .30. The largest correlations were 
between Confidence During class and MAT scaled score (-.29) 
and MAT national percentile (-.29). This indicates greater 
confidence is associated with higher achievement scores. 
The correlations between t\xj Unknown control construct and 
the achievement scores were at least .20, indicating that 
students who tend to endorse these statements (lower scores 
indicixte mors of the construct, i.e., less of a sense of 
control over success or failure) are those who tend to do 
less well on these tests. The low correlations for the 
const >nicts and achievement measures also indicates the 
indep ..wdence of the achievement and MAQ constructs. 

Discriminant Analyses 

A discriminant analysis was used to examine whether 
student responses to the summed psychological constructs 
would discriminate among four groups: high achieving boys, 
low cichieving boys, high achieving girls and low achieving 
girls. In these analyses high achievers were defined as 
students who fell within the top 30% of the sample on the 
MAT national percentiles. Separate analyses were performed 
for each of the three activity settings. 

In the During Class setting there were 156 low 
achieving boys, 207 low achieving girls, 181 high achieving 
boys, and 207 high achieving girls. Two discriminant 
functions accurately classified 45% of the students in the 
four groups (X^(30) = 239.82 p < .0001). After removal of 
the first function, the second function further 
discriminated the groups (X^(18) = 58.80, p < .0001). The 
first eigenvalue was .279 and the second .073. The first 
discriminant function most separated high and low achievers 
and the second function most discriminated between boys and 
gixris. To interpret the discriminant functions the 
correlations greater than .30 between the statements and the 
discriminant functions were examined. 

Correlations with the first function indicated that low 
achievers were less Confident (.75), had less of a sense of 
control (-.63), did not attribute success to Inte^^nal Stable 
Uncontrollable causes ( 49), were more Anxious (-.42) and 
more likely to attribute success to External Stable 
Uncontrollable causes (-.34). The second function 
discriminated between boys and girls. Boys more often 
attributed success to External Stable Uncontrollable causes 
(.68) and Internal Stable Uncontrollable causes (.54), 
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reported more External Performance Goals (.60) and had less 
of a sense of control (Unknown Control) over their successes 
or failures (.31) than girls. 

In the Working With Other Students setting there were 
161 low achieving boys, 192 low achieving girls, 179 high 
achieving boys, and 198 high achieving girls. Two 
discriminant functions accurately classified 41% of the 
students (X^(30) 169.54, p < .0001). After removal of the 
first function, the second function further discriminated 
the groups (X^(18) = 59.83, p < .0001). The first two 
eigenvalues were .164 and .068. The first function 
discriminated between the high and low achievers. Low 
achievers tend to have less of a sense of control. Unknown 
Control (.88), to be motivated by External Perfonnaiice Goals 
^.64), to attribute failure to External Stable 
Uncontrollable causes (.50), to be more Anxious (.49), to 
have less Confidence (^.42), and to attribute failure to 
Internal Stable Controllable causes (.41). The second 
function discriminated between boys and girls. Boys more 
often attributed success to Internal Stable Uncontrpllable 
causes (,59), reported less Interest in working word 
problems in a group (-.47) , reported greater Confidence 
(.43) ^nd more External Performance Goals (.38). 

In the Homework setting there were 187 high achieving 
boys, 150 low achifiVing girls, 199 high achieving boys, and 
213 high achieving girls. Two discriminant functions 
accurately clasoxfied 43% of the students (X2.(30) = 177.86, 
p < .0001). After removal of the first function^ the second 
function further discriminated the groups (X^(18) = 5?.. 52, 
p < .0001). The first function discriminated between the 
high and low achievers. Low achievers tended to have less 
Confidence (-.63), to attribute failure to Internal Stable 
Uncontrollable causes (.57), to be mo-re Anxious (.57), to 
attribute failure to External Stable Uncontrollable causes 
(.56), to have less of a sense of control (.55), ana to not 
be motivated by External Performance Goals (-.31). Boys 
reported less of a sense of control (.62), more often 
attributed failure to Internal Stable Tjncontrollable causes 
(.53), reported less Value for homework word problems 
(-.47) , were more often motivated by both Internal Learning 
Goals and External Performance Goals (.38). 



i 0 



MAQ Technical Report 
V - 1 



CHAPTER V 

REPORTS FOR MEANING AND USE 

The statements of the Mathematics Assessment 
Questionnaire have been written to provide information for 
classroom instructional planning. Two approaches to 
examining student responses are recommended for the MAQ, ! 
One approach is to use the item level responses for an / 
individual or for a group. This can be used with all the / 
MAQ statements. It is ttie only approach used for the / 
Metacognitive and Self -Regulatory statements, in the area/of 
"Directed Cognition," Another approach can be used with /the 
3-item clusters of the affective, motivational and / 
attributional constructs, in the area of "Intentionality, " 
This second approach is the use of CRT-type indicators./ 

Directed Cognition: Use of Statement-^Level Responds 

The approach taken to examining student responses in 
the Metacognitive and Self-Regulatory categories is at the 
individual statement level. These statements have NOT been 
summed for a total "Metacognitive", or "Self -Regulatory" 
score because of the characteristics of the statements and 
of the characteristics of student responses to the I 
statements. For both sections the statements have oeen 
organized or grouped into logical units of before, /during, 
and after a activity. The activities are solving an 
individual problem, or learning about and solving ^ord 
problems in the settings of During Class, Working Mith Other 
Students, or Homework, The reasons for examining /only 
responses to individual statements are as follows/ 

• Although the before, during, ano after units' are 
logical, in the actual problPi- "?;clving processes 
students work back and forth a: ong the thinKing 
activities. This has been d^.scribed for tne 
metacognitive activities in a group problem-solving 
setting (Artzt and Armour-Thomas, 1990) arid for 
individual problem solvers (Schoenfeld, 1/985) , 

. . / 
, For the Metacognitive statements, some sictivities are 

mote likely to be used or are more appifopriate for some 

problems than for others. Teacher ratings of the 

appropriateness of the statements for^ the coin problem, 

for ekample, will vary, / 

, The use\ of the statements or prompts in these sections 
results in obtaining student reflections about these 
processed, rather than obtaining more direct 
observatibn of /adents at work or /thinking aloud 
during the'^problem-solving process'. 

The statemen;ts thus impose a part/icular structure on 
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student responses, and it is not justifiable to summarize 
the responses for any of the sections to obtain a total 
score for a student or a mean score for a class* This 
conclusion is supported by statistical analyses of \:he 
statements and student responses, which indicate that there 
is not a single factor or dimension underlying the groups ox 
statements for Metacognitive and Self -Regulatory statements 
(see Chapter IV), 

Ii; summary, the approach to using student responses to 
the MAQ for the Metacognitive and Self-Regulatory statements 
is on an individual statement basis. Examples of individual 
and class responses as well as uses for t!ie responses are 
given in Chapter IV of the Manual for Users . The remaining 
items in the MAQ can also be examined on an individual 
statement basis. However, a different CRT-type of score has 
been developed for them. 

Intentionality: Use of CRT--Type scores 

Criterion or objective referenced scores have been 
useful in achievement testing. Such scores typically have 
mor'i direct meaning for instructional planning: 

1. they are referenced to smaller units of statements 
or questions, typically from 3-6; and 

2. a standard or cutoff score is set indicating mastery 
or non-mastery in the achievement test context, where "non- 
mastery" indicates a x)eed for further classroom instruction. 

In the context of the MAQ a similar strategy has been 
developed for the 3-item clusters of the affective beliefs, 
motivations and attributions in each setting. Criterion- 
referenced test-like scores were created for individual 
students on each of the 3-statement clusters. These scores 
indicate if students have 0, 1, 2, or 3 responses to the 
three statements in a cluster in a manner indicating the 
need for follow-up instructional planning by the teacher. 
The CRT-type score has direct meaning, as opposed to the use 
of summed scores on the five point rating scales. Summed 
scores on the five point rating scale can range from 3 to 
15, and students can have different response patterns for 
the same score. 

The use of the need criteria provides a direct 
interpretation for use in instructional planning in the 
following manner. A student is identified as having "need" 
for follow-up by the teacher when the student responds to at 
least 2 of the 3 statements in a cluster so as to indicate a 
need. On any single item, the student has to select one of 
the two most extreme response options to indicate need. For 
the affective beliefs, low Value, low Interest, low 
Confidence and high Anxiety are indicators of need. For the 
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Motivations, being motivated by External Performance Goals 
and not motivated by Internal Learning Goals ara indicators 
of need. For the attributions, one indicator of need is 
success or failure which is not attributed to causes which 
are Internal Stable Controllable. Other indicators for need 
for the attributions include success or failure attributed 
to causes which are External Stable Uncontrollable, Internal 
Stable Uncontrollable, or a feeling of Unknown Control. A 
list of item numbers for each category and the direction in 
which they are counted to determine if they meet the 
criteria of need are presented in Appendix 5-1. 

The statistical procedures for creating these CRT-type 
scores for a 3-item cluster are as follows: 

1) Responses to each item are dichotomized: If students 
select either of the two extreme response options which 
indicate need in that area, they receive a "1," 
otherwise a "0." 

2) The number of I's is summed across the three 
statement cluster. 

3) If this sum equals 2 :>r 3, students are identified 
as in need of attencion in that area. 

An example of how a CRT-type score is computed follows for 
the construct of Anxiety in the Homework setting. 

Suppose a student responds to the three Anxiety items: 

ANXIETY: 



VERY TRUE 
TRUE 



SORT 

OP 
TRUE 



NOT 
VERY 
TRUE 



MOT AT 
ALL 
TRUE 



19. 



I feel nervous when 
I think about doing 
hard word problems for 
homework. 



26. 



I feel relaxed when 
I am doing math word 
problems at home. 



36. 



Doing word problems 
for homework do%.s not 
make me nervous. 



* 
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The student's responses are then receded: 

it eiu 19 - student reports fr-aling anxious as indicated 
by a response in one of the two extrerae categories* (a VERY 
TRUE response); - the student receives a "1" for this 
response 

iteiA 26 - the student reports feeling anxious as 
reported in one of the two extreme categories, (a NOT AT ALL 
TRUE response) - student receives a for this response 

item 23 - the student does not report feeling anxious 
as indicated by marking one of the two extreme categories • 
(a TRUE response) - student receives a "0" for this 
response • To receive a "1" the student would have had to 
respond NOT VERY TRUE or NOT AT ALL TRUE* 

The "I's" are summed. The total of 2 falls within the 
cutoff (two or three responses indicating need) • Therefore 
this student is identified for follow-up work by the teacher 
to determine whether instructional activities are needed in 
this area. 

An Alternative CRT-approach. 

An alternative CRT-scoring scheme was also examined. 
Rather than identifying the two most extreme responses (VERY 
TRUE and TRUE or NOT VERY TRUE and NOT AT ALL TRUE, 
depending upon the statement) the three most extreme 
categories were considered as indicative of "need." Thus, 
unlike the previous procedure, the SORT OF TRUE category was 
considered as indicating need. 

This alternative scoring system, and the original CRT 
type scoring were compared on two features: 

1. Internal consistency, as estimated by coefficient 
alpha; and 

2. The number of students identified as in need for 
follow-up work using Loth CRT approaches. 

Alpha reliability coefficients were computed based upon 
the CRT-ceding. That is, the coefficients were based upon 
the dichotomized 0 or 1 scores. These results were compared 
with the coefficients based upon the raw data (summing of 
original ratings) . The three sets of coefficient alpha 
reliabilities are presented in TaHe 5-1. In Table 5-1 
Alpha 1 is the reliability based on the raw, summed scores. 
Alpha 2 is the CRT indicator using the two extreme 
categories to form the dichotomy. Alpha 3 is the CRT 
indicator using the two extreme rating categories plus the 
middle rating category to form the dichotomy. 
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TABLE 5-1 

coefficient Alpha Reliabilities of Responses to Three Item 
Clusters of Affective Beliefs, Motivations and Attributions 
Based on Summed Scores (Alphal) , CP.T Version 1 (Alpha2) , and 

CRT Version 2 (Alphas) 



Activity Setting 



Psychological 
Construct 



During Working with 

Class other Students 



Homework 



Value^ 
Items 
Alphal 
Alpha2 
Alphas 



(26) 28 34 
.500 
.374 
.431 



32 44 (46) 
.394 
,333 
.287 



(12) 20 (39)^ 
.483 
.320 
.425 



Interest 
It<*ms 
Alphal 
Alpha2 
Alpha3 



24 (44) 49 
.335 
.273 
.247 



30 36 (40) 
.487 
.412 
.442 



18 (34) 28 
.725 
.659 
.619 



C '^nf idence 
Items 
Alphal 
Alpha2 
Alpha3 



20 (31) (48) 
.548 
.303 
.302 



24 (27) 48 
.412 
.249 
.382 



(13) 22 (35) 
.611 
.413 
.522 



Anxiety 
Items 
Alphal 
Alpha2 
Alpha3 



(27) 35 (39) 
.576 
.484 
.490 



(25) 31 (51) 
.520 
.414 
.429 



(19) 26 36 
.451 
.339 
.425 



Internal Learning Goals 
Items 30 32 43 

Alphal .710 
Alpha2 .449 
Alphas .632 



29 23 39 
.698 
.596 
.637 



15 31 23 
.386 
.369 
.422 
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TABLE 5-1 (continued) 



Psychological 
Construct 



Activity Setting 



During Working With 

Class Other Students 



Homework 



External Performance Goals 
Items 25 36 40 

Alphal .203 
Alpha2 .193 
Alpha3 .142 



37 43 53 
.532 
.469 
.475 



14 33 29 
.543 
.471 
.502 



Internal Stable Controllable 

Items 3 45 47 34 41 49 

Alphal .620 .610 

Alpha2 .525 .572 

Alpha3 .523 .541 



17 25 37 
.605 
.505 
.541 



Internal Stable Uncontrollable 

Items 22 37 41 26 38 52 

Alphal .592 .621 

Alpha2 .515 .556 

Alpha3 .472 .545 



10 16 38 
.730 
.639 
.682 



External Stable Uncontrollable 

Items 23 29 46 35 50 45 

Alphal ,418 .613 

Alpha2 .358 .476 

Alpha3 .356 .554 



21 32 27 
.603 
.512 
.516 



Unknown Control 
Items 
Alphal 
Alpha2 
Alpha3 



21 33 38 
.683 
.524 
.632 



28 42 47 
.588 
.466 
.544 



11 30 24 
.661 
.567 
.592 



Alphal= raw scores. Alpha2= CRT Version 1 (2 extreme 
response categories). Alpha3= CRT Version 2 (3 extreme 
response categories) . 

Coding of items in parentheses is reversed. 
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As might be expected, the coefficients based upon the 
dichotomized scores typically were lower than the 
coefficients based upon the raw scores. The difference in 
the alphas between the CRT (with 2 extreme categories) and 
the siunmed raw scores alpha ranged from .01 to .27, with a 
median difference of .10. However, large, consistent 
differences in the alpha reliability coefficients were not 
found between the two CRT approaches. The differences 
between the two CRT sets of alphas ranged from .00 to .19 
with 20 of the 30 alphas having differences of .05 or less, 
six of .06-. 10, and two of .11, one of .14 and one of .19. 

The number of students out of 1737 who would be 
ivientified as needing follow-up work were compared based 
upon both CRT scoring systems. The results are presented 
for constructs in each of the three settings in Tables 5-2, 
5-3 and 5-4. The tables present the number of students for 
teacher follow-up based on two of the three statements in a 
cluster, three of the three statements in a cluster, and the 
total of both (i.e., 2 or 3 statements). 

The first scoring system, version 1, included the items 
which had been dichotomized so two extreme responses 
indicated need. Using this version between 7% (N=115) and 
44% (N=763) of the students were identified for teacher 
follow-up. The alternative scoring system, called version 
2, identified between 22% (N=384) and 76% (N=1327) of the 
students as needing instructional follow-up. In version 2 
items were dichotomized so that the two extreme responses 
plus the middle category indicated need. Based on the 
modest alpha reliabilities of both CRT-type scores, the more 
conservative approach, that is, identifying smaller numbers 
of scudents, is most appropriate. Since there were not 
consistent or large differences between the reliability 
coefficients based upon the two coding procedures, the 
first, more conservative CRT-coding procedures has been 
adopted. 
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TABLE 5-2 



During Class Activity Setting: 
Numbers of Students Identified as Needing Follow-up 
Classroom Activities Using Alternative Scoring Procedures 
Based Upon Responses to at Least 2 of 3 Statements 



Psychological 
Construct 



VERSION ONE 
Number of statements 
indicating need 

2/3 3/3 Total 



VERSION TWO 
Number of statements 
indicating need 



2/3 3/3 



Total 



value 


loo 


OQ 


21o 


A f\ 
'iOl 


258 


•7 T O 

718 


Interest 


337 


95 


432 


649 


351 


1000 


Confidence 


128 


22 


150 


361 


214 


575 


Anxiety 


260 


114 


374 


433 


369 


802 


Internal 
Learning Goals 


223 


68 


291 


452 


395 


847 


External 

Performance Goals 


613 


83 


696 


884 


281 


1065 


Internal Stable 
Controllable 


115 


0 


115 


398 


285 


683 


Internal Stable 
Uncont rol lable 


453 


310 


763 


485 


842 


1327 


External Stable 
Uncontrollable 


266 


83 


349 


519 


332 


851 


TTnknown Control 


121 


55 


176 


281 


208 


489 



Version 1: dichotomized so 2 extreme responses versus the 
other 3 response categories. 

Version 2: dichotomized so 2 extreme responses plus middle 
category versus the other 2 response categories. 
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TABLE 5-3 



Working With Other Students Activity Setting: 
Nimbers of Students Identified as Needing Follow-up 
Classroom Activities Using Alternative Scoring Procedures 
Based Upon Responses to at Least 2 of 3 Statements 



VERSION ONE VERSION T^^O 

Number of statements Number of statements 

indicating need indicating need 

Psychological 

Construct 2/3 3/3 Total 2/3 3/3 Total 



Value 


373 


44 


417 


752 


240 


992 


Interest 


228 


74 


302 


495 


293 


788 


Confidence 


119 


21 


140 


458 


147 


605 


Anxiety 


175 


48 


223 


434 


193 


627 


Internal 
Learning Goals 


167 


86 


253 


367 


359 


726 


External 

Performance Goals 


7A2 


65 


308 


461 


191 


652 


Internal Stable 
Controllable 


423 


298 


721 


486 


738 


1224 


Internal Stable 
Uncontrol lable 


409 


237 


646 


492 


754 


1246 


External Stable 
Uncontrollable 


180 


59 


248 


458 


291 


749 


Unknown Control 


145 


54 


199 


313 


228 


541 



Version 1: dichotomized so 2 extreme responses versus the 
other 3 response categories* 

Version 2: dichotomized so 2 extreme responses plus middle 
category versus the other 2 response categories. 
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TABLE 5-4 

Hoiaework Activity Setting: 
Numbers of Students Identified as Needing Follow-up 
Classroom Activities Using Alternative Scoring Procedures 
Based Upon Responses to at Least 2 of 3 Statements 



Psychological 
Construct 



VERSION ONE 
Number of statements 
indicating need 

2/3 3/3 Total 



VERSION TWO 
Number of statements 
indicating need 

2/3 3/3 Total 



Value 


196 


44 


240 


481 


251 


732 


Interest 


342 


314 


656 


442 


792 


1234 


Confidence 


115 


29 


144 


344 


167 


511 


Anxiety 


3 69 


53 


222 


417 


338 


655 


Internal 
Learning Goals 


355 


357 


712^ 


446 


783 


1239 


External 

Performance Goals 


449 


236 


685 


532 


632 


1164 


Internal Stable 
Controllable 


138 


44 


182 


450 


314 


764 


Internal Stable 
Uncontrollable 


113 


53 


166 


235 


149 


384 


External Stable 
Uncontrollable 


238 


71 


309 


517 


279 


796 


Unknown Control 


172 


70 


242 


388 


259 


647 


Version l: dichotonized 


SO 2 


extreme 


responses 


versus 


the 



other 3 response categories. 
Version 2: dichotomized so 2 extreme responses plus middle 
category versus the other 2 response categories. 
^ only two of thrtse items were retained for analysis. 
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Source Questionnaire: Classification of Statements 



NAME 



TODA/'S DATE 



SCHOOL 



GRADE 



TEACHER'S NAME 



PERIOD 



CIRCLE: 



BOY 



GIRL 



YOUR AGE 



WHICH BEST DESCRIBES YOU: ASIAN BLACK HISPANIC WHITE OTHER 



The questions in this booklet ask about what you think and 
feel about doing math word problcons. This is not a test. YOU DO 
NOT HAVE TO ANSWER ANY QUESTION YOU DO NOT WANT TO. This is jv^t 
a way to get your ideas about math. You will not be graded on 
your answers and the information will not af f ::t your grades or 
school work. Please answer each question carefully. Be sure tc 
answer BOTH sides of each page. 



Copyright © 1990 Carol Kehr Tittle, Heborah Hecht 
Center for Advanced Study in Education 
Graduate School and University Center 
Citj University of New York 
June 1990 



No portion of this publication may be reproduced without the 
prior written permission of the authors 



SOURCE QUESTIONNAIRE 



Items classified as written 
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PART I 

First solve the problem. Use the space below to work on the 
problem. Then answer the statements about what you thought and 
did as you worked the problem. 



Eight pennies are arranged in a row on a table. Every other coin 
is replaced with a nickel. Then, every third coin is replaced with a 
dime. Finally, every fourth coin is replaced with a quarter. What is 
the total value of the coins on the taO^le? 



Now go to the next page and say what you did. 
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BEFORE YOU BEGAN TO SOLVE THE PROBLEM - WHAT DID YOU DO? 

Try to think of exactly what you did. Circle the answer that bast 

describes what you think you did. 



NO 

No, I didn't 
do this 



MAYBE 
I may have 
done this 



YES 
Yes, I did 
do this 



1. I re^d the problem more than once. NO MAYBE YES 

2. I thought to myself^ Do I understand NO MAYBE YES 

what the question is asking me? 

3. I tried to put the problem into my NO MAYBE YES 

own words. 

4. I tried to remember if I had worked NO MAYBE YES 
a problem like this before. 

5. I thought about what information I NO MAYBE YES 

needed to soXve this problem. 

6. I asked myself, Is there information NO MAYBE YES 
in this problem that I don't need? 

7. I wrote down important information. NO MAYBE YES 



AS YOU WORKED THE PROBLEM - WHAT DID YOU DO? Circle the answer 
that best describes what you think you did. 

8. I thought about all the steps as NO MAYBE YES 
I worksd the problem. 

9. I kept looking back at the problem NO MAYBE YES 
after I did a step. 

10. I had to stop and rethink a .tep NO MAYBE YES 

I had already done. 

11 I checked my woi:k step-by-step as NO MAYBE YES 

I worked the problem. 
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AFTER YOU FINISHED WORKING THE PROBLFJ! - WHAT DID YOU DO? Circle the 
answer that best describes what you think you did. 



NO 

No, I didn't 
do this 



MAYBE 
I may have 
done this 



12. I looked back to see if I did the 
correct procedures. 

13. I checked to see if my 
calculations were correct. 



NO 



NO 



YES 
Yes, I did 
do this 



MAYBE 



MAYBE 



YES 



YES 



14. I went back and checked my work NO MAYBE YES 
again. 

15. I looked back at the problem to NO MAYBE YES 
see if my answer made sense. 

16. I thought about a different way to NO MAYBE YES 
solve the problem. 



DID YOU USE ANY OF THESE WAYS OF WORKING? Circle the answer that 
best describes what you think you did. 



17. I drew a picture to help me 
understand the problem. 

18. I "guessed and checked." 

19. I picked out the operations I 
needed to do this problem. 

20. I felt confused and could not 
decide what to do. 



NO 

NO 
NO 

NO 



MAYBE 

MAYBE 
MAYBE 

MAYBE 



YES 

YES 
YES 

YES 
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PART II 



INSTRUCTIONf 

WHAT HAPPENS WHEN YOU WORK .:ORD PROBLEMS IN VARIOUS SETTINGS ~ 
at school, in a group, at home? 

How tnae is each stateisi^nt for you? Circle your answer: (1) if very 
true, (2) if true, (3) if sort of true, (4) if not very true, or (5) if 
not at all true. 



DURING CLASS 

Think about when your teacher teaches about word problems. What do you 
do before the lesson begins, during the lesson, and after the lesson? 
Try to think of exactly what you do. How true is each statement for you? 
Circle your answer. 



1 2 3 4 5 

Very True Sort of Not Very Not At 

True True True All True 



AT THE BEGINNING OF A MATH LESSON ABOUT WORD PROBLEMS: 

1. I get ready to listen carefully. 1 self reg 5 

2. I make sure I have all the materials 1 self reg 5 
I need. 

3. I make sure I am paying attention. 1 self reg 5 

4. i know when the teacher is reviewing 1 self reg 5 
material already taught. 

5. I know when the teacher is beginning a 1 self reg 5 
new math idee:. 

6. I know when the teacher is giving me 1 self reg 5 
practice in new math problems • 



128 



Appendix 3-1 page 6 



1 2 3 4 5 

Very True Sort of Not Very Not At 

True True True All True 



DURING A MATH LESSON ABOUT WORD PROBLEMS: 

7. I think about what is important to 1 self reg 
learn in the lesson. 

8. I know what the teacher is going to do l self reg 
next in the lesson. 

9. I think of an answer to a question the 1 self reg 
teacher is asking. 

10. I think about whether I understand an 1 self reg 
example the teacher puts on the board. 

11. When my math teacher makes a mistake, 1 self reg 
I say something about the error. 

12. I ask my math teacher to explain a 1 self reg 
problem again that I do not understand. 

13. When I can think of another way to 1 self reg 
solve a word problem, I volunteer to 

show the class. 

14. I know when the teacher is about to 1 self reg 
end the lesson or topic. 

AT THE END OF A MATH LESSON ABOUT WORD PROBLEMS: 

15. I ask myself if I understand the lesson. 1 self reg 

16. I try to figure out if I need to do 1 self reg 
more to learn the lesson. 

17. I decide if I need to ask the teacher 1 self reg 
a question about the lesson. 

18. I review the word problems my teacher 1 self reg 
did. 

19. When I review word problems from class, 1 self reg 
I evaluate if 1 understood the lesson. 
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DURING CLASS 

Think about when your teacher teaches about word problems* What do 
you think and feel? How true is each statement for you? circle 
your answer. 



1 

Very 
True 



2 

True 



Sort of 
True 



Not Very 
True 



5 

Not At 
All True 



20. I feel confident that I will be able 1 
to follow any word problem my math teacher 
explains in class. 



21. When I correctly answer a question my 
teacher asks about word problems, I 
usually do not know why I get it right. 

22. If I correctly answer a question my 
teacher asks about word problems, it is 
because I have the cibility to learn 
math. 



confidence 5 



1 unkn control 5 



ISU 



23. If I understand the word problems my 
teacher does on the board, it is 
because I have a good teacher. 

24. I enjoy trying to answer the math word 
problems my teacher asks in class. 

25. I only answer questions about word 
problems in math class to please my 
teacher. 

2 6. Even when I listen to my teacher, I 

cannot understand how learning to solve 
word problems will help me in my 
everyday life. 

27. I C5m afraid when I have to ask my math 
teacher a question about a word 
problem during class. 

28. It is important to learn to do the 
types of word problems my teacher 
explains in class. 

29. If I am able to solve a word problem on 
the b.jard, it is because the problem 
was easy. 



ESU 5 

interest 5 

EPG 5 

value 5 



anxiety 5 



value 5 



ESU 
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1 

Very 
True 



2 

True 



Sort of 
True 



Not Very 
True 



5 

Not At 
All True 



DURING CLASS: 

30. I volunteer to do word problems on the 
board so I can learn something more 
about math. 

31. I do not expect to be able to answer 
the questions my math teacher asks 
about word problems • 

32. I pay attention during my teacher's 
lessons on word problems because it 
helps ice learn math. 

33. I usually do not know what is going on 
when my teacher is explaining a word 
problem. 

34. Listening to my math teacher explain 
word problems during class helps me see 
how important math is. 

35. When I am in math class, I usually feel 
very much at ease and relaxed. 

36. I pay attention when my teacher 
explains word problems if I know I will 
have a test on them. 

37. If I can follow my teacher's 
explanation for word problems, it is 
because I am smart. 

38. I do not know why I cannot follow the 
word problems my teacher works on the 
board. 

39. I get scared when I have to work a word 
problem on the board. 

40. I volunteer to do a word problem on the 
board if I think it will help my grade. 

41. If I can solve a word problem the 
teacher puts on the board, it is 

because I think mathematically. 



1 ILG 5 

1 confidence 5 

1 ILG 5 

1 unkn control 5 

1 value 5 

1 anxiety 5 

1 EPG 5 

1 ISU 5 

1 unkn control 5 

1 anxiety 5 

1 EPG 5 

1 ISU 5 
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1 

Very 
True 



2 

True 



Sort of 
True 



Not Very 
True 



5 

Not At 
All True 



DURING CLASS: 

42. J volunteer to answer questions about 
vord problems in math class because 
it helps me understand the math. 

43. If I understand a word problem my 
teacher is explaining, it is because 
I am trying as hard as I can, 

44. I get bored when other students are 
working word problems on the board in 
math class. 

45. The next time my math teacher explains 
a word problem to the class, I expect 
to understand be<^ause I always listen 
carefully. 

46. If I correctly answer a question the 
teacher asks about a word problem, it 
is because the teacher picxs good 
problems^ 

47. Because I pay attention, I know I will 
be able to understand the word problems 
my teacher explains in class. 

48. If my math teacher asks me to solve a 
word problem on the board, I am sure 
I will get the wrong answer. 

49. I like to do new word problems by 
myself, even before the teacher 
explains them. 



ILG 



ISC 



interest 5 



ISC 



ESU 



ISC 



confidence 5 



interest 5 
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WITH OTHER STUDENTS 

Think about solving a word problem with a group of other students. 
If you have never solved a word problem with other students, imagine what 
it would be like. What do you do before beginning to work, as you work 
and after you are done? Try to think of exactly what you do. How true 
is each statement for you? Circle your answer. 

1 2 3 4 5 

Very True Sort of Not Very Not At 

True True True All True 



BEFORE BEGINNING TO SOLVE A WORD PROBLEM WITH OTHER STUDENTS I 

1. I make sure I have all the materials 1 self rag 
I will need. 

2. I try to work the p\.)blem by myself 1 self reg 
first. 

3. I think about how long it will take 1 self reg 
us ?c ve can plan our time. 

4. I say to the other students what I 1 self reg 
think the prob?.em is asking. 

5. I say to the other students how the 1 self reg 
problem is like other problems I 

have worked. 

6. I say to the other students what I 1 self reg 
think we should do first. 

7. I say to the other students what 1 self reg 
information we need to use to work the 

problem. 
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1 

Very 
True 



2 

True 



Sort of 
True 



Not Very 
True 



5 

Not At 
All True 



WHILE WORKING A WORD PROBLEM WITH OTHER STUDENTS: 

8. I say to the other students if I think 1 self reg 
something should be worked differently. 

9. I talk to the other studen^^j about how 1 self reg 
other problems are like the one we are 

working on. 

10. I ask the other students questions 1 self req 
about the problem. 

11. I explain to the other students why 1 1 self reg 
think my answer or procedure is right. 

12. I encourage the other students to work 1 self reg 
on the problem too. 

13. I listen carefully to what everyone 1 self reg 
says about the problem. 

14. I keep looking back at the problem 1 self reg 
to make certain we are doing what we 

need to do. 

15. I keep track of what everyone says. 1 self reg 

AFTER DOING A WORD PROBLEM WITH OTHER STUDENTS: 

16. We check each other's ideas. 1 self reg 

17. I look over all the work we did to 1 self reg 
see if we used the fight procedures. 

18. I check to see if our calculatiom; 1 self reg 
are right. 

19. I ask the other students whether anyone 1 self reg 
thinks the answer is vrong. 

20. I say to the other s^tudents whether I 1 self reg 
think the answer makes sense. 

21. I ask the other students if anyone has 1 self reg 
a different way to solve the problem. 

22. I know if I learned Vixys to do the word 1 self reg 
problem. 

23. I know if I will be able to solve 1 self reg 
word problems like this. 



5 
5 
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WITH OTHER STUDENTS 

What do you think and feel about doing word problems with other students? 
How true is each statement for you? Circle your answer. 



1 2 3 4 5 

Ve-y Truo Sort of Not Very Not At 

True True True All True 



24* If I worked with other students, I am 1 
sure 1 could solve most math word problems, 

25, I dread the thought of trying to solve 1 
a math word problem with other students. 

26, If I solve a word problem working with 1 
other students, it is because we 

think mathematically. 

27, I have no confidence in my ability to 1 
solve a word problem with other 

students. 



28, If I could iiot solve a word problem 
with others students, I would have no 
idea why we could not solve it. 

29, I would work hard on a word problem 
with other students because it would 
help me understand how to do the 

problems. 

30, I think it would be interesting to work 
on a math word problem with other 
students . 

31, I feel comfortable when I work on a 
word problem with other students. 

32, If I work with other students on a word 
problem I see how useful math is. 

33, I would work hard on a word problem 
with other students if I could learn 
more math that way. 



confidence 5 

anxiety 5 

ISU 5 

confidence 5 



1 unkn control 5 



ILG 



interest 5 

anxiety 5 

value 5 

ILG 5 
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1 

Very 
True 



2 

True 



3 

Sort of 
True 



Not Very 
True 



5 

Not At 
All True 



WITH OTHER STUDENTS: 

34. If X cannot solve a word problem with 
other students, it is because we did 
not try as hard as we could on the 
problem. 

35. If I cannot solve a math word problem 
with a group of students, it is because 
the problem is too long. 

36. I would find math interesting if I 
worked on a word problem with a 
group of students. 

37. I would work on a word problem with 
other students only if my friends 
told me I should. 

38. If I can solve a word problem with 
other students, it is because we have 
enough ability. 

39. I would like to try and solve a 
challenging word problem with other 
students because I would learn a lot. 

40. Word problems would not be interesting 
to me if I did them with a group of 
students . 

41. if I cannot solve a word problem with 
other students, it is because we fooled 
around. 

42. When I solve a word problem with other 
studeits I am never sure how we solved 
the problem. 

43. I would work on a word problem with 
other students only if I could get a 
better math grade. 

44. Word problems seem more important 
when I am working hard on them with 
other students. 



ISC 



ESU 



1 interest 5 



EPG 



ISU 



ILG 



1 interest 5 



ISC 



1 unkn control 5 



EPG 



1 value 
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B 
I 



1 

Very 
True 



2 

True 



Sort of 
True 



Not Very 
True 



5 

Not At 
All True 



WITH OTHER STUDENTS: 

45. Tf I cannot solve a math word problem 
with a group of students, it is because 
the teacher did not give us a problem 
like that before. 

46. If I worked a word problem with oth^r 
students, I would see that the problem 
is a waste of time. 

47. If I could solve a word problem with 
other students, I would not know why 
we got it right. 

48. If I worked on a word problem with 
other students, I know I would be able 
to help to solve the problem. 

49. If I cannot solve a word problem 
working with other students, it is 
because we were careless. 

50. If I cannot solve a math word problem 
with a group of students, it is because 
the problem was hard. 

51. I feel nervous when I work on a word 
problem with other students. 

52. If I solve a word problem working with 
other students, it is because we are 
smart. 

53. I would work on a word problem with 
other students only if I was told to 
Dy my teacher. 



ESU 



1 value 5 

1 unkn control 5 

1 confidence 5 

1 ISC 5 

1 ESU 5 

1 anxiety 5 

1 ISU 5 

1 EPG 5 



ERLC 



54. How often do you work word problems with other students? Chec 
the box with your answer. 

[ ] 4 or more times a week 

[ ] 2-3 times a week 

[ ] once a week 

[ ] less than once a week 

[ ] I've never worked with other students 
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HOMEWORK 

Think about when you work word problems for homework. What do you do 

before you begin, as you work and after you are done? How true is each 
statement for you? Circle your answer. 

1 2 3 4 5 

Very True Sort of Not Very Not At 

True True True *ill True 



BEFORE YOU BEGIN TO WORK THE HOMEWORK WORD PROBLEMS. 

1. I decide when is the best time to do 1 self reg 5 
my math homework word problems* 

2. I decide how much time to spend on my 1 self reg 5 
math homework word problems. 

3. I make sure I have all the materials I 1 self reg 5 
need. 

WHILE WORKING THE HOMEWORK WORD PROBLEMS: 

4. I read each problem carefully. 1 self reg 5 

5. I keep track of ny work as I am doing 1 self reg 5 
a homework word problem. 

6. I make sure I try every problem, even 1 self reg 5 
if I cannot solve them all. 

AFTER WORKING THE HOMEWORK WORD PROBLEMS: 

7. If I cannot do the word problems, I 1 self reg 5 
write out all the steps I can do 

and bring them to class. 

8. II' i do not understand the homework word 1 self reg 5 
problems, I ask the teacher to explain 

them. 

9. I review my homework word problems 1 self reg 5 
before class. 
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HOMEWORK 

Think about when you work word problems for homeT^iork, What do you think 
and feel? How true is each statement for you? Circle your answer. 



1 2 3 4 5 

Very True Sort of Not Very Not At 

True True True All True 



10. If I am not able to do my next math 
homework word problems, it is because 
I am not clever in math. 

11. When I cannot do my math homework word 
problems, I usually do not know why. 

12. I do not see any use for the word 
problems I get for homework. 

13. I never expect to be able to do the 
types of word problems I get for math 
homework. 

14. The only reason I would do extra 
homework problems is if I could get 
extra credit. 

15. I do not like to do word problems for 
homework unless I can learn something 
new by doing them. 

16. I will not be able to do my next 
homework word problems because I do not 
have the ability to do them. 

17. If I am able to do word problems for 
homework, it is because I listen in 
class. 

18. I like working on math homework word 
problems. 

19. I feel nervous when I think about 
doing hard word problems for homework. 

20. Being good at solving homework word 
problems which involve math or 
reasoning mathematically is very 
important to me. 

21. I will not be able to do word problems 
^or homework unless the problems are easy< 



1 ISU 5 

1 unkn control 5 

1 value 5 

1 confidence 5 

1 EPG 5 

1 ILG 5 

1 ISU 5 

1 ISC 5 

1 interest 5 

1 anxiety 5 

1 value 5 



ESU 
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1 

Very 
True 



2 3 4 5 

True Sort of Not Very lot At 

True Tx-ue All True 



HOMEWORK: 

22. I have a lot of confidence that I 
can do homework word problems. 

23. I like to do hard homework word 
problems because I leara more math by 
working them. 

24. If I get homework word problems right, 
I usually do not know why. 

25. If I can do the word problems I get for 
homework, it is because I spend 
enough time on them. 

26. I feel relaxed when I am doing math 
word problems at home. 

27. If I am unable to do homework word 
problems, it is because the math book 
is confusing. 

28. The math word problems I get for 
homework are interesting to me. 

29. I would do challenging . th word 
problems for homework if I could 
get a better grade. 

30. I usually do not understand why I get 
word problems for homework wrong. 

31. I like to do challenging wo^d 
prcblems for homework because 
solving them helps xne learn math. 

32. If I cannot do homework word problems, 
it is because the problems are 
confusing. 

33. The only reason I do my math homework 
word problems is because my math 
teacher tells me I have to. 

34. Working on word problems for homewck 
is very boring. 



1 confidence 5 



IL6 



1 unkn control 5 



ISC 



1 anxiety 5 



ESU 



1 interest 5 



EPG 



1 unkn control 5 



ILG 



ESU 



EPG 



1 interest 5 
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1 

Very 
Trxie 



2 

True 



Sort of 
True 



Not Very 
True 



5 

Not At 
All True 



HOMEWORK: 

35. I do not have any confidence when it 
comes to doing word problems for homework. 

36. Doing word problems for homework 
does not make me nervous. 

37. I know I can do word problems for 
homework because I work hard on them. 

38. If I cannot do math homework word 
problems, it is because I am not smvxrt 
enough . 

39. Being able to solve the word problems 

I get for homework is not important to me. 



confidence 5 

anxiety 5 

ISC 5 

ISU 5 

value 5 
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1 n 

1 u 


2 


\ \ 


2 


4 


1 


158 


26 


132 


22 


157 


26 


64 


14 


67 


11 


4 


1 


232 


39 


159 


27 




?2 


52 


9 


28 


4 


4 


1 


90 


15 


101 


17 


139 


23 


123 


r 1 


147 


25 


2 


0 


104 


17 


155 


26 


172 


29 


95 


it^ 


73 


12 


3 


0 


174 


29 


213 


35 


132 


22 




8 


35 


6 


1 


0 


157 


26 


189 


32 


164 


27 


48 


t 


40 


7 


4 


1 


172 


29 


210 


35 


135 


2? 


53 


9 


29 


5 


3 


0 


111 


19 


137 


23 


195 


3^ 


92 


15 


63 


11 


4 


1 


115 


19 


206 


35 


174 


28 




10 


43 


7 


3 


0 



school 



Mathematics Assessment Questionnaire: A Survey of Thouohts and Feelinos. for Students in Grades 7-9 
TOTAL (Grades 7. 8) 



Qrade Seven 



(N-600) 



Verv 
1 r \g 



T rue 



Sort 
Of 

T rue 



Not 
Very 
T rue 



Not At 
At I 
T rue 



Mi ss i PQ 



Uues t i on 
Id 

DURING CLASS 
Othar Thouoh 
DURINQ20 
DURINQ21 
DURINQ22 
DURiNQ?3 
DURIKci24 
DURINQ25 
DURINQ26 
DUR1NQ27 
DUR1NQ28 
DUR1NQ29 
DURING30 
DURING31 
DURIN032 
DURING33 
DUK1N034 
OURING39 
DUR1N036 
DUR1NQ37 
OUR1NG38 
OURING39 
OURUG40 
0URING41 
DURING42 
DURiNG43 
0URtNG44 
0URING45 
0URiNG4e 
0URING47 
0URING4e 
DURING49 



N 


% 


N 


% 


N 




N 


% 


N 


% 


N % 


ts and Fee 1 i nQS 










24 




6 1 


163 


27 


2 1 4 


36 


1 4 D 


C u 


4 7 


g 


4 


61 


10 


101 


1 7 


83 


1 4 


4 4 4 

111 


1 a 


9 9 Q 
C C a 


3 9 


1 5 C 


200 


34 


164 


3 1 


126 


2 1 


OO 


Q 


C 9 




1 2 i 


172 


29 


134 


23 


144 


25 


C A 

50 


A 
\3 


0 u 


1 u 




125 


21 


164 


28 


137 


2 3 


f u 


1 C 




1 A 


1 3 4 


36 


6 


45 


8 


73 


1 3 


1 3£> 


c o 


5 0 5 


iJ W 


1 9 » 


68 


15 


75 


1 3 


1 20 


?0 


4 A A 

1 uu 


4 7 
1 # 


5 

CViJ 


O kJ 


1 2 < 


90 


15 


66 


1 2 


121 


2 1 


4 AA 
1 00 


1 f 


5 n7 




1 4 4 


262 


4 4 


181 


J 1 


97 


1 6 


c ( 




5 ^ 




1 0 


73 


12 


54 


9 


133 


2 3 


4 C A 

1 3D 


C D 


1 / 0 


^ n 


c 


129 


22 


146 


25 


140 


c 4 


A Q 


1 t\ 

1 iJ 


87 


1 5 


g 


59 


10 


90 


15 


90 


1 

i o 


4 A 


9 7 


1 R 1 


3 1 


1 6 


189 


32 


173 


29 


1 A7 
1 O / 


CO 


" g 


7 


2 1 


4 


1 1 


30 


5 


44 


8 


95 


1 0 


1 4A 


24 


272 


47 


16 


147 


25 


150 


26 


180 


31 


66 


11 


42 


7 


15 


129 


22 


-|4 7 


25 


140 


24 


79 


14 


89 


16 


16 


251 


43 


181 


31 


87 


15 


30 


5 


31 


5 


20 


1 i5 


20 


125 


21 


172 


30 


101 


17 


70 


12 


17 


25 


4 


43 


7 


99 


17 


139 


24 


274 


47 


20 


88 


15 


72 


12 


118 


20 


106 


18 


202 


34 


14 


141 


24 


113 


19 


153 


26 


79 


14 


97 


17 


17 


lie 


20 


142 


24 


144 


24 


102 


17 


85 


14 


1 1 


162 


27 


178 


30 


154 


26 


57 


10 


42 


7 


7 


197 


33 


171 


29 


129 


22 


65 


11 


31 


5 


7 


117 


20 


61 


10 


142 


24 


131 


22 


141 


24 


6 


129 


2? 


193 


33 


186 


31 


56 


9 


27 


5 


9 


52 


9 


83 


14 


157 


27 


167 


26 


129 


22 


12 


194 


33 


191 


32 


136 


23 


45 


d 


27 


5 


7 


36 


6 


49 


8 


89 


15 


162 


31 


236 


40 


8 


127 


21 


125 


21 


148 


25 


100 


17 


92 


16 


8 



Grade ElQht 



(N»602) 



Verv 
T rue 



True 



Sort 
Of 

T rue 



Not 
Verv 
T rue 



Not At 
U I 
T rue 



Mi ssl no 



N 


% 


N 


% 


N 


% 


N 




N 


% 


N 


% 


131 


22 


199 


33 


180 


30 


67 


1 1 


20 


2 


5 


1 


27 


5 


59 


10 


111 


M 


39 


24 


255 


43 


1 1 


2 


172 


29 


202 


34 


.46 


2t 


49 


8 


19 


3 


13 


2 


129 


22. 


134 


23 


170 


29 


73 


12 


67 


15 


9 




118 


20 


130 


22 


180 


30 


78 


13 


88 


15 


8 




23 


4 


35 


6 


68 


12 


158 


27 


306 


52 


1 2 




93 


16 


' 55 


9 


144 


24 


107 


18 


197 


33 


6 




67 


11 


66 


1 1 


111 


19 


121 


20 


230 


39 


7 




227 


38 


199 


34 


124 


21 


23 


4 


21 


4 


8 




51 


9> 


66 


1 1 


111 


19 


106 


33 


170 


/•29 


6 




95 


16, 


120 


20 


180 


30 


110 


16 


93 


16 


4 




35 


6 


76 


13 


119 


20 


164 


31 


178 


30 


10 




167 


28 


199 


33 


165 


28 


45 


8 


22 


4 


4 




25 


4 


35 


6 


90 


15 


170 


29 


276 


46 


6 




108 


18 


132 


22 


194 


33 


108 


1 8 


56 


a 

9 


O 




116 


19 


135 


23 


155 


26 


95 


16 


94 


16 


7 




277 


47 


166 


28 


90 


16 


4 0' 


7 


21 


4 


8 




99 


17 


122 


21 


178 


30 


121 


21 


69 


12 


13 




26 


4 


56 


9 


95 


1 S 


137 


23 


276 


47 


12 




81 


14 


69 


12 


112 


19 


119 


20 


214 


36 


7 




143 


24 


117 


20 


134 


22 


91 


15 


112 


19 


5 




76 


13 


145 


24 


189 


32 


109 


18 


79 


13 


4 




136 


23- 


171 


29 


161 


27 


88 


15 


44 


7 


2 




153 


26- 


184 


31 


150 


25 


73 


12 


36 


6 


6 




61 


10 


83 


14 


136 


23 


167 


26 


150 


25 


5 




102 


17 


197 


33 


193 


32 


86 


1 4 


19 


3 


5 




37 


6 


68 


1 1 


120 


20 


205 


34 


165 


28 


7 




140 


24 


221 


37 


143 


24 


66 


1 1 


)c3 


4 


7 




21 


4 


19 


3 


106 


18 


190 


32 


261 


44 


5 




137 


23 


130 


22 


108 


18 


131 


22 


94 


16 


2 


0 
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School: TOTAL (Grades 7. 8) 



Orade Seven (N-600) 













Sort 




Not 




Not i 










Verv 








Of 




Verv 




Al 1 










T rue 




T rue 




T rue 




T rue 




T rue 




Ml SS 1 na 


Quest I on 


















































Id 


N 




N 


% 


N 


% 


N 


% 


N 


% 


N 


% 




WITH OTHERS 






















Wmfnrm fiAninnino 
























Wl TH01 


230 


Jo 


197 


33 


112 


19 


42 


7 


18 


3 


1 


0 


MITH02 


2ia 


9 C 
OD 


237 


40 


94 


16 


32 


5 


17 


3 


2 


0 


WITH03 


60 


1 U 


135 


23 


147 


25 


116 


20 


136 


23 


6 


1 


MITH04 


89 


1 u 


1 58 


27 


141 


24 


96 


16 


110 


19 


6 


1 


W1TH05 


54 




96 


1 6 


146 


25 


14i 


24 


156 


26 


5 


1 


WtTHOe 


107 


18 


1 63 


27 


117 


20 


100 


17 


108 


18 


5 


1 


Mil TMn? 


125 


21 


1 53 


26 


120 


20 


85 


1 4 


113 


19 


4 


1 


























Ml TH08 


98 


16 


1 90 


32 


133 


22 




14 


90 


15 


8 


1 


W!TK09 


57 


10 


1 32 


22 


1 48 


25 


122 


21 


135 


23 


6 


1 


W1TH010 


88 


15 


158 


27 


141 


24 


80 


15 


116 


\0 




1 


MITH01 1 


113 


19 


168 


32 


122 


21 


82 


14 


85 


14 


12 


2 


MITH012 


93 


16 


1 43 


24 


133 


23 


92 


16 


124 


21 


15 


3 


WITKOia 


147 


25 


211 


36 


122 


21 


71 


12 


42 


7 


7 


1 


M1TH014 


204 


34 


1 98 


33 


112 


1 9 


3U 


a 
0 




5 


7 


1 


lAii Tum ^ 


113 


19 


157 


27 


159 


27 


93 


16 


66 


11 


12 


2 


























WITH016 


132 


22 


178 


30 


120 


20 


72 


12 


91 


15 


7 


1 


MITH017 


144 


25 


202 


34 


126 


22 


63 


1 1 


51 


9 


14 


2 


MITH018 


187 


28 


214 


:>6 


103 


17 


54 


9 


52 


9 


10 


2 


MITH019 


118 


20 


185 


31 


127 


21 


69 


12 


94 


16 


7 


1 


WITH020 


109 


18 


181 


31 


132 


22 


79 


13 


89 


15 


10 


2 


WtTH021 


97 


16 


170 


;.9 


125 


21 


99 


17 


101 


17 


8 


1 


MITH02 2 


127 


22 


238 


40 


143 


24 


50 


9 


30 


5 


12 


2 


WITH023 


158 


27 


236 


40 


129 


22 


41 


7 


29 


5 


7 


1 
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Grade Elaht (N«602) 











So r t 




Non: 




Not i 








Very 








Of 




Verv 




Al 1 








T rue 




1 1 UO 




T Tije 




T rue 




T rue 




Ml ss t na 


N 




N 


% 


N 


% 


N 


% 


N 


% 


N 


% 


Iff 


2 9 


£ 1 £ 




1 43 


24 


37 


6 


33 


5 


r\ 
u 


r\ 
u 


216 


4 A 

oo 


00 A 


3 7 


118 


20 


36 


6 


8 


1 


0 


0 


52 


9 


1 £ O 


2 c 


1 J Q 


26 


139 


23 


127 


21 


6 


1 


114 


1 9 


1 a Q 
■ Bo 


J 2 




23 


9 1 


15 


67 


1 1 


c 
D 


4 

1 


58 


1 0 


11/ 


2 U 


1 J A 


C M 


149 


25 


126 


21 


( 


4 

1 


133 


22 


174 


29 


129 


21 


83 


14 


82 


?4 


1 


0 


119 


20 


167 


28 


150 


25 


91 


15 


73 


1 2 


2 


0 


123 


2 1 


214 


OO 


1 J u 


22 


70 


12 


62 


10 


« 
o 


u 


64 


1 1 


142 


24 


1 oO 


9 3 




25 


1 05 


18 


c 
D 




96 


"i * 


205 


34 


^ A A 




73 


1 2 


78 


13 


6 




141 


^4 


O 4 4 
211 


oD 


1 9#l 
1 £ D 




w o 


1 2 


49 


6 


4 




97 


1 6 


4 A A 
1 OO 


2 0 


1 J3 
1 40 


24 


1 00 


17 


88 


15 


6 




152 


CD 


2 1/ 


3 A 


152 


25 


53 


9 


23 


4 


5 




189 


32 


235 


39 


107 


18 


49 


8 


19 


3 


3 




96 


16 


163 


27 


189 


;J2 


92 


16 


53 


9 


0 




151 


25 


188 


31 


130 


22 


75 


13 


54 


9 


4 




157 


25 


215 


36 


135 


23 


60 


10 


29 


5 


6 




1i}2 


30 


230 


38 


126 


21 


41 


7 


20 


3 


4 




131 


22 


187 


31 


143 


24 


71 


12 


63 


11 


7 




135 


23 


187 


31 


134 


22 


84 


14 


56 


9 


6 




103 


17 


173 


29 


144 


24 


95 


16 


79 


13 


8 




145 


25 


223 


38 


150 


26 


44 


7 


26 


4 


14 


2 


1/1 


24 


247 


42 


141 


24 


48 


6 


17 


3 


8 


1 



147 



School : 



Mathematics Assessment Cues t J onna I ro : 
TOTAL (Grades 1\ 8) 
Grade Seven (N-600) 



A survey of Thoughts end FeoMngs. for Students in Gredes 7-9 



Sort 

Very Of 
True True True 



Not Not At 

Very AM 
True True 



Mi ss i no 



Quest i on 
Id 



N 



N 



N 



WORKING WITH OTHEP,S 
Other Thouahts end FeeMnqs 



m TH02 4 

m\ TH025 

WITH026 

m\ TH027 

WlTH02a 

W1THO20 

m\ THO30 

WITH031 

m\ TH032 

WtTH033 

WtTH034 

WITH035 

W1THO30 

W1TH037 

WtTH03e 

WITHO30 

Wl THO40 

W1TH041 

W1TH042 

WITH043 

W1TH044 

W1TH045 

W1THO40 

W1TH047 

WlTH04fi 

WITH049 

W1THO50 

W1TH051 

WITH06^' 

W1TH053 



138 
42 
81 
28 
60 
132 
185 
122 
94 
159 
:09 
22 
84 
24 
134 
129 
55 
89 
40 
87 
87 
63 
35 
36 
129 
59 
55 
47 
89 
97 



23 172 
7 83 
14 148 
5 58 
10 85 

22 200 
28 184 

21 148 
16 137 
27 184 
16 141 

4 64 

14 144 
4 49 

23 178 

22 173 
9 62 

15 87 

7 58 
15 94 
15 116 
11 72 

6 54 
6 70 
22 196 
10 82 
9 99 

8 53 

15 128 

16 111 



29 
14 
25 
lO 
15 
34 
31 
25 
24 
Z8 
24 
1 1 
25 
8 
31 
29 
1 1 
15 
10 
16 
20 
12 
9 
12 
33 
14 
17 
9 
22 
19 



163 
115 
180 
80 
150 
149 
121 
166 
182 
156 
163 
93 
158 
61 
155 
150 
129 
135 
99 
109 
168 
158 
93 
89 
161 
137 
173 
113 
181 
130 





N 




N 


% 


N 


% 


28 


66 


1 1 


53 


9 


8 


1 


19 


137 


23 


214 


36 


9 


2 


31 


83 


14 


94 


16 


14 


2 


14 


118 


20 


298 


51 


18 


3 


26 


138 


24 


146 


25 


21 


4 


25 


53 


9 


54 


9 


12 


2 


21 


52 


n 


64 


1 1 


14 


Z 


28 


76 


13 


74 


13 


14 


2 


31 


82 


14 


86 


15 


19 


3 


27 


50 


9 


59 


10 


12 


2 


28 


100 


17 


79 


13 


8 


1 


16 


182 


31 


229 


39 


10 


2 


27 


99 


17 


102 


17 


13 


2 


10 


138 


23 


321 


54 


9 


2 


27 


63 


1 1 


53 


9 


17 


3 


25 


63 


1 1 


75 


13 


10 


2 


22 


150 


26 


189 


32 


15 


3 


23 


112 


19 


157 


27 


20 


3 


M 


169 


29 


221 


38 


13 


2 


19 


127 


22 


170 


29 


13 


2 


28 


115 


19 


104 


18 


10 


2 


27 


149 


25 


147 


25 


1 1 


2 


16 


162 


27 




42 


4 


1 


15 


161 


27 


Zlj 


40 


9 


2 


27 


65 


1 1 


39 


7 


10 


2 


23 


148 


25 


^57 


27 


17 


3 


29 


134 


2*^ 


^6 


21 


13 


2 


19 


144 


24 


.32 


39 


1 1 


2 


31 


109 


18 


84 


14 


9 


2 


22 


126 


21 


132 


22 


4 


1 



Grade ElQht (N«602) 



Very 
T rue 


T rue 


Sort 
Of 

T rue 


Not 
Very 
T rue 


Not At 
Al 1 
T rue 


Mi ss i na 


N 


% N % 


N % 


N % 


N % 


N % 



132 
35 
62 
20 
44 
135 
1 48 
128 
64 
151 
90 
10 
92 
14 
136 
123 
43 
87 
28 
50 
75 
54 
21 
36 
133 
44 
43 
36 
82 
74 



?2 195 
6 59 

M 138 
5 54 
8 77 

23 213 

25 191 

22 180 

14 117 
25 197 

15 135 
2 49 

16 1(3 
2 40 

23 18T 
21 158 



7 
15 
5 
9 



68 
81 
41 

91 



13 115 
9 82 



43 

53 



23 197 
8 76 



101 
65 



14 123 
13 120 



33 156 
10 110 
23 182 
9 65 

13 144 
36 159 

32 141 
30 152 
20 172 

33 130 
23 146 

8 101 
18 180 

7 46 
32 148 
27 160 

12 113 

14 142 
7 101 

16 110 

20 163 
14 145 

7 81 

9 90 

34 189 

13 160 

17 197 
1 1 64 

21 190 
20 138 



26 70 
19 173 
31 129 
11 143 
25 172 

27 53 



24 

26 



69 
76 



29 135 
23 60 
25 129 
17 223 
32 119 
8 148 



25 
28 



71 
88 



19 170 

24 135 
17 207 
19 160 
28 135 

25 178 

14 202 

15 179 

32 44 
27 164 
34 147 
14 140 

33 119 
23 129 



12 44 
29 217 
22 78 
24 312 
29 148 
9 31 



12 
13 
23 
10 
22 



47 

58 
80 
46 
87 



38 206 
20 85 
25 340 
12 41 
15 51 

29 189 
23 138 
36 201 
28 169 

23 96 

30 131 
34 242 

31 227 
8 22 

28 138 
25 98 

24 250 
20 69 
22 130 



7 
37 
13 
53 
25 
5 
8 
10 
14 
8 
15 
35 
14 
58 
7 
9 
32 
24 
35 
29 
16 
22 
41 
39 
4 
2 4 
17 
44 
12 
22 



5 
8 
13 
8 
17 
1 1 
6 
8 
14 
& 
13 
13 
14 
14 
19 
22 
19 
19 
24 
22 
18 
12 
13 
17 
17 
20 
16 
18 
19 
1 1 



1 

1 

2 

1 

3 

2 

1 

1 

2 

1 

2 

2 

2 

2 

3 

4 

3 

3 

4 

4 

3 

2 

2 

3 

3 

3 

3 

3 

3 
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4 2-3 1 < 1 ^ 

/Week /week /Week /Week Never Missing 
Question ....... ----- 

WORKING IN A GROUP _ 

INQRP 39 7 102 18 81 14 128 22 220 39 30 5 



4 

/Week 



2.3 
/Week 



/Week 



< 1 
/Week 



Never 



Ml ss i na 



40 



N%N%N%N% N% 
95 17 57 10 197 34 185 32 28 5 
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School 



Ma'c.tematiss Assessment Quest I 
TOT At (Oredes 7. 8) 
Orede Seven (N-600) 



onnelre: A Survey of ThouQhts end Keellnas, for Students In Oredes 7-8 



Vsrv 



Sort 

Of 



Hot 

Very 



Not At 
At I 
True 



Uissina 



Quest ion 
td 



H 



HOMEWORK 

Before Beainntna 

H0UEWK1 183 31 156 

H0UEWK2 107 18 137 

HOMEWnca 239 40 178 
Uhl lieMMorkina 

H0MC)MK4 283 47 191 

H0MEMK5 22/ 38 238 

HOUEWKB 244 41 213 
After Worlcino 

H0MEWK7 109 18 140 

K0UEWK8 168 28 190 

K0MEWK9 82 14 123 



% 


N 


% 


N 


% 


N 


% 


N 


26 


106 


18 


67 


11 


87 


15 


1 


23 


88 


15 


122 


20 


144 


24 


2 


30 


105 


18 


40 


7 


35 


6 


3 


32 


85 


14 


23 




14 


2 


4 


40 


83 


14 


29 


5 


22 


4 


1 


38 


94 


18 


28 


5 


17 


3 


4 


24 


161 


25 


91 


15 


104 


17 


5 


32 


142 


24 


53 




49 


8 


0 


21 


139 


23 


111 


19 


144 


24 


1 



0 
0 

1 
1 

0 

1 
1 

0 
0 



Grade Elaht (N=602) 



Very 
True 




True 




Sort 
Of 

True 




Not 

Very 

True 




Hot 
At 1 
True 


At 


Misstna 


N 


% 


N 


% 


H 


% 


N 


% 


N 


% 


N % 


170 
87 
209 


Oft 

16 
35 


1 09 

124 
183 


c c 
21 
31 


117 
112 

123 


20 
19 
21 


67 
125 
44 


11 
21 
7 


80 
147 
39 


13 
25 
7 


3 0 
7 1 

4 1 


292 
237 
239 


49 
40 
40 


215 
234 
220 


36 
39 
37 


66 
92 
89 


11 
ife 
15 


10 
24 
28 


2 
4 

5 


15 
12 
23 


3 
2 
4 


4 1 
3 0 
3 0 


106 
172 
70 


18 

29 
12 


145 
201 
101 


24 
34 

17 


144 

133 
166 


24 

22 
28 


107 
59 
132 


18 
10 

22 


94 

32 
129 


16 

5 
22 


6 1 
6 1 
4 1 



Pmi'm B: 
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Mathematics Assessment Questionnaire: A Survey 



of Thoughts and Feolings. for Students in Grades 7-9 



School : 


TOTAL (Grades 7. 
Grade Seven 


8) 

(N«600) 






Grade Elaht 




• 








Very 

True True 


Sort Not 
Of Very 
True True 


Not At 
Al \ 
T rue 


Mi ss i no 


Very 

True True 


Sort 
Of 

T rue 


Not 
''<*ry 
f rue 


Not At 
Al 1 
T rue 


Missf na 


Ques 1 1 on 
Id 


N % N % 


N % N % 


N % 


N % 


N % N % 


N % 


N % 


N % 


N % 



Fall 1986 
Paae 7 



HOMEWORK 
Other Thoughts 

HOMEWK10 40 

HOMEWK11 45 

HOMEWK12 64 

H0MEWK13 39 

HOMEWK14 141 

HOMEWK15 99 

HOMEWK 16 2 4 

HOMF.«rKl7 176 

H04/EWK16 70 

HOitEWKl9 01 

HCUi^i|IK20 116 

HOMU*K21 31 

HOUEWK22 204 

HOUEWK23 122 

H0UEWK24 43 

HOMEWK25 124 

HOMEIMK26 151 

HOUEWK27 46 

HOUEWK28 02 

HOME«K29 143 

HOMEWfK30 50 

H0MEWK31 115 

HOME)MK32 69 

HOUEWK33 104 

HOMEWK34 130 

HOMEWK35 40 

HOilEMK30 185 

HOMEWK37 128 

HOUEWK30 23 

HOUEMK39 85 



and Fee mas 

7 5b 9 

8 77 13 

11 62 11 
7 60 10 

24 106 18 
17 117 20 

4 56 9 
30 i99 33 

12 105 18 
10 71 12 
19 158 27 

5 48 8 
34 198 33 
21 136 23 

7 75 13 

21 191 32 

25 172 29 

8 64 14 
14 114 19 
24 137 23 

a 92 16 

19 152 26 

12 127 21 

17 101 17 

22 85 14 
7 47 8 

31 189 32 

22 178 30 

4 35 6 

14 61 10 



88 
140 
121 
104 
129 
155 
58 
141 
192 
142 
195 
77 
134 
155 
67 
172 
140 
150 
169 
141 
136 
158 
184 
147 
172 
86 
89 
193 
66 
93 



15 147 
24 154 

2» 

18 138 
22 97 
26 108 
10 143 
24 54 

32 97 
24 132 

33 73 
13 167 



22 
20 



34 

78 



11 146 
29 64 

23 67 
25 149 

28 115 

24 87 
23 160 
27 84 
31 114 

25 113 

29 115 

14 153 

15 60 
33 53 
11 159 

16 121 



'-5 
26 
20 
23 
16 
18 
24 
9 
16 
22 
12 
28 
6 
13 
25 
11 
11 
25 
19 
15 
28 
14 
19 
19 
19 
26 
10 
9 
27 
20 



266 
178 
226 
251 
120 
118 
313 
26 
129 
184 
53 
272 
27 
104 
259 
40 
67 
161 
114 
83 
144 
81 
99 
130 
94 
270 
73 
33 
311 
236 



45 

30 

38 

42 

20 

20 

53 
4 

22 

31 
9 
46 
5 
17 
44 
7 
1 1 
27 
19 
14 
24 
1 4 
17 
22 
16 
45 
12 
6 
52 
40 



3 

6 
10 

8 

7 

3 

6 

4 

7 
10 

5 

5 

3 

5 
10 

9 

3 
10 
6 
9 
10 
10 
7 
5 
4 
4 
4 

15 
6 
4 



1 

1 

2 

1 

1 

1 

1 

1 

1 

2 

1 

1 

1 

1 

2 

2 

1 

2 

1 

2 

2 

2 

1 

1 

1 

1 

1 

3 

1 

1 



31 
29 
54 
27 
148 
84 
24 
149 
75 
46 
114 
36 
178 
112 
27 
116 
144 
43 
67 
12e 
37 
101 
■*4 
96 
127 
44 
205 
113 
20 
iiO 



5 
5 
9 
5 



48 
67 
61 
64 
25 122 
14 120 

4 56 
25 192 
13 103 

8 57 
19 156 

6 52 
30 195 
19 130 

5 53 
19 173 
24 175 

r 73 
11 107 
22 143 

6 69 
17 149 
13 110 

1 i3 
95 
42 
34 172 
19 174 
38 
53 



16 
21 
7 



3 
10 



8 93 
11 164 

10 123 

11 109 

21 131 
20 159 
10 71 

32 181 

17 158 
10 134 
27 193 

9 72 

33 160 

22 160 
9 63 

29 192 
29 158 
13 174 

18 189 

24 131 
12 136 

25 172 

19 219 
19 148 
16 16'^ 

7 76 
29 106 
29 229 
6 63 
9 96 



16 194 

28 165 

21 167 
19 169 

22 87 
27 124 
12 168 
30 47 
2 ' '.06 
23 

32 6'J 

12 181 
27 46 
27 107 
11 193 
32 72 

27 65 

29 169 
32 132 
22 113 
26 161 
29 102 
37 115 
25 116 

28 119 

13 173 



16 
38 



67 
60 



11 183 
16 165 



33 227 

28 167 

29 179 
29 219 
15 103 

21 103 
29 ?,S9 

8 25 
18 150 
24 210 
12 60 
31 251 

8 20 

18 87 
33 256 43 
12 42 
1 1 53 
29 128 

22 100 17 

19 76 

27 170 
17 64 
19 72 

19 122 

20 89 
29 265 44 
1 1 52 
10 20 
31 296 

28 222 



38 
26 
31 
37 
17 
17 
46 

4 
25 
36 
10 
42 

3 
15 



7 
9 
22 



13 
29 
11 
12 
21 
15 



9 
3 
49 

37 



9 

10 

18 

1 4 

11 

12 

14 
8 

10 

11 
8 

10 
3 
6 

10 
7 
7 

12 
7 

1 1 
9 

14 

12 
7 
7 
2 
0 
6 
2 
6 



1 

2 

3 

2 

2 

2 

2 

1 

2 

2 
1 

2 

0 
1 
2 
1 
1 
2 
1 
2 
1 
2 
2 
1 
1 
0 
0 
1 
0 
1 
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Mathematics Assassmant Questionnaire: A Survey of Thoughts and Feallnqs, for Students In Grades 7-9 
School: TOTAL (Grade 9) 

Grade Nine (N-535) 



Fall 1088 
Rape 1 



Question 
Id 



No 

N % 



Mavbe 

N % 



Yes 

N 



. MORKINO A MATH PR03LEM 
Before /ou Begin 
MET1 
MET2 
MET3 
MET4 
MET5 
|yiET6 
MET7 

As You Work 

MEYQ 
MET10 
MET 11 

Af tar You F i ni sti 
MET12 
METIS 
MET 14 
\ METIS 
MET 16 

Strategias Used 
MET 17 
MET18 
MET19 
MET20 



Mi S5 i ng 
N % 



29 


5 


29 


5 


477 


89 


0 


0 


64 


1 2 


111 


21 


354 


67 


6 


1 


2 25 


42 


72 


14 


234 


44 


4 


1 


330 


62 


68 


13 


133 


25 


4 


1 


40 


8 


66 


12 


424 


80 


5 


1 


300 


56 


106 


20 


125 


24 


4 


1 


150 


28 


67 


13 


311 


59 


7 


1 


72 


1 4 


61 


12 


393 


75 


9 


2 


55 


10 


49 


9 


425 


60 


6 


1 


186 


35 


101 


19 


239 


45 


9 


2 


as 


17 


107 


20 


33S 


63 


2 


0 


80 


15 


93 


17 


359 


67 


3 


1 


64 


16 


74 


14 


372 


70 


5 


1 


175 


33 


95 


IS 


259 


49 


6 


1 


97 


18 


81 


15 


349 


66 


8 


1 


374 


71 


67 


13 


88 


1 7 


6 


1 


120 


24 


31 


6 


372 


70 


4 


1 


432 


83 


52 


10 


39 


7 


12 


2 


122 


23 


99 


3 


303 


58 


11 


2 


353 


67 


96 


18 


76 


14 


10 


2 
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M.th.m.tics A ment Questionnaire: A Survey of Thouflhts .nd Feellnos. for Students In 



Grades 7-9 



School : TOTAL (Grade 9) 



Quest \ on 
Id 



DURING CLASS 
BeQinninQ of Lesson 

OURINGI 123 23 194 

0URINQ2 130 25 194 

0URJWG3 143 27 190 

0URIN04 209 39 202 

OURINGd 247 4$ 192 

OURINGd 224 42 224 
Our i na Le s son 



Very 
T rue 


T rue 


Sort 
Of 

T rue 


Not 
Very 
T rue 


Not At 
Al 1 
T rue 


Mi s s i no 


N % 


N % 


N % 


N % 


N % 


N % 



0URIN07 101 

0URtNG8 2 1 

OURtNOQ 151 

0URING10 202 

OURINOll 135 
DUR1NG12 
DUR1N013 
DURINQ14 
End of Lesson 

0URIN015 169 

0URING16 139 

0URIN017 126 

OURIMOie 94 

0UAiNG19 96 



19 
4 
26 
36 
25 

160 30 
51 10 
80 17 

32 
26 
24 
16 
16 



179 
66 
241 
2>51 
128 
142 
72 
111 

183 
166 
187 
145 
176 



36 167 
,^7 141 
36 17) 
3C 69 



36 
42 



62 
55 



34 160 
12 167 
45 107 
45 74 
24 124 
27 126 
14 112 
21 167 

34 113 

35 133 
35 122 
27 142 
33 161 



35 
27 
32 
17 
12 
10 



20 
14 

23 
24 



22 
46 

26 
23 
22 
16 



30 67 

31 173 



20 
12 
61 
60 



21 124 
31 93 



22 
25 
23 
27 
30 



36 
49 
67 
63 
62 



4 

2 
15 
11 



6 

17 
5 
6 
10 
1 1 



13 27 
32 106 



13 
4 
69 
44 



?,7i 172 
16 71 



7 
9 
13 
16 
12 



29 
26 
30 
70 
34 



1 
3 
1 
2 
2 
2 

5 
20 
2 
1 

13 
8 
32 
13 

5 
6 
6 
13 
6 



3 
5 
1 
4 

2 
3 

1 
2 
3 
2 
0 
1 
4 
4 

0 
1 
1 
1 
2 



1 
1 
0 
1 
0 

1 

0 
0 

1 

0 
0 
0 

1 
1 

0 
0 
0 
0 
0 
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. . n -.cMonnnlre- A Survev of Thoi'Ohts and Feelings, for Students In Grades 7-9 
Mathematics Assessment Questionnaire. a ourvev uj i mui m 



School : TOTAL (Grade 9) 

Grade Nine (N-535) 



Fall 1660 
Page 3 



Ques 1 1 on 
Id 

DURING CLASS 

Othtr Though 

DURING20 

DURtNG21 

DUR1NQ22 

DURING23 

DURING24 

DURiNG25 

DUR1HG28 

DUR1NG27 

DURlNG2a 

DURING29 

DURINGdO 

DUR!NG31 

DURiNG32 

DUR1NG33 

DURING34 

DURING35 

DURlN03d 

DURING37 

DUR!N&3a 

DURING39 

DURtNG40 

DURtNQ41 

DURING42 

DURiNG43 

DURING44 

DURING45 

DUR1NG46 

DURING47 

DURtNC46 

DURING49 



Very 
T rue 


T rue 


Sort 
Of 

T rue 


Not 

Ve rv 
True 


Not At 
Al 1 
T rue 


Ml s s i no 


N % 


N % 


N % 


N % 


N % 


N % 



ts an 
93 
33 
145 
66 
70 

16 
99 
62 
162 

55 

75 

37 
132 

25 

71 

71 
253 

68 

33 

73 
1/5 

60 

96 
146 

71 

91 

26 
127 

20 

74 



d Feel i 
17 153 

6 65 
2 7 X90 
17 113 

13 111 
3 32 

19 69 

12 66 
35 165 

10 45 

14 116 

7 64 

25 192 

5 52 

13 136 

13 109 
46 141 
17 107 

6 54 

14 52 
27 134 

11 123 

16 157 

26 179 

13 77 

17 153 
5 60 

24 176 
4 33 

14 106 



ngs 
29 
12 
36 
21 
21 
6 
13 
12 
31 
6 
22 
12 
36 
10 
26 
21 
27 
20 
10 
10 
25 
2 3 
30 
34 
15 
29 
1 1 
33 
6 
20 



193 
95 
132 
157 
172 
73 
12U 
116 
126 
129 
144 
145 
142 
66 
146 
149 
63 
157 
109 
^2^ 
125 
167 
177 
125 
129 
164 
131 
146 
99 
116 



36 60 

16 137 

25 n 
3 0 L J 
32 95 
14 14b 
24 114 

22 101 
24 42 
24 161 
27 124 
27 162 
27 43 

17 165 

26 122 
26 110 
16 31 
30 113 

21 133 

23 111 

24 75 
35 1 11 
33 69 
24 66 

24 153 
35 63 

25 160 

26 52 
19 190 

22 120 



11 

26 
6 

15 

16 

26 

21 

19 
6 

04 

23 

30 
6 

35 

23 

21 
6 
21 
25 
21 
14 
21 
13 
12 
29 
16 
34 
10 
36 
23 



33 
191 
29 
91 
62 
252 
124 
165 
10 
121 
73 
125 
21 
161 
50 
90 
19 
61 
199 
173 
52 
50 
31 
12 
96 
16 
126 
23 
189 
1 13 



6 
37 
5 
17 
15 
46 
23 
35 
2 
23 
14 
23 
4 
34 
9 
17 
4 
12 
36 
33 
10 
9 
6 
2 
19 
3 
24 
4 
36 
21 



3 

14 
7 
6 
5 

12 
4 
3 
3 
4 
1 
2 
5 
4 
6 

e 

7 
4 
4 
4 
3 
5 
7 
6 
10 
9 
4 
4 
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Mathematics Assessment Questionnaire. A Survey of ThouQhts and Feellnqs. for Students In Grades 



School: TOTAL (Grade 9) 





Grade 


Nl ne 




(N- 


535) 
























Sor t 




No t 




No t 


A t 








Very 








Of 




Very 




A 1 1 










T rue 




f rue 




T rue 




T r o'i 




T rue 




Mi ss t na 


Quest t on 


















N 




N 




Id 


N 


% 


ti 




U 




M 


% 


% 




V^RKINO Wl TH OTHERS 






















before SealnnInQ 
















1 6 




1 




Wl THOl 


160 


30 


1 98 


37 


122 


23 


36 


7 


3 


0 


WiTHOa 


176 


33 


9 1 J 

£ 1 4 


40 


93 


16 


32 


6 


16 


3 


4 


1 


WITH03 


42 


6 




17 


136 


26 


150 


26 


1 1 2 


2 1 


5 


1 


WITH04 


64 


16 


IOC 


31 


133 


25 


8/ 


16 


66 


12 


6 


1 


Wl TH05 


27 


5 


M\A 
I U ^ 


20 


142 


27 


146 


27 


1 14 


21 


2 


0 


Wl TH06 


95 


18 


« T 0 

lie 


32 


105 


20 


63 


16 


77 


14 


3 


1 


Wl TH07 


92 


17 


163 


31 


126 


24 


62 


15 


71 


13 


1 


0 


While Work ma 
















54 


10 






Wl TH08 


64 


16 


1 93 


36 


129 


24 


73 


14 


2 


0 


WITH09 


41 


6 


123 


23 


146 


26 


124 


23 


96 


16 


3 


1 


W1TH010 


77 


14 


1/0 


33 


141 


27 


76 


14 


62 


12 


3 


1 


Wl THOl 1 


106 


20 


2 00 


3D 


102 


19 


74 


1-: 


43 


6 


2 


0 


WITH012 


91 


17 


I Ac 


27 


117 


22 


96 


16 


63 


16 


4 


1 


WITH013 


106 


20 


c c c 


42 


122 


23 


46 


9 


32 


6 


5 


1 


Wl TH014 


150 


26 


214 


40 


99 


19 


47 


9 


23 


4 


2 


0 


WITH015 


73 


14 


146 


26 


151 


29 


9 1 


1 7 


62 


12 


10 


2 


After Workina 
























WITH016 


103 


19 


195 


37 


1 1 1 


21 


66 


12 


56 


1 1 


2 


0 


WI7H017 


122 


23 


213 


40 


123 


24 


47 


9 


21 


4 


4 


1 


WiTHOld 


136 


26 


246 


47 


66 


17 


44 


6 


13 


2 


4 


1 


with:^i9 


65 


16 


200 


36 


115 


22 


63 


16 


46 


9 


4 


1 


WITH020 


75 


14 


209 


39 


133 


25 


70 


13 


46 


9 


2 


0 


Wl YH021 


^7 


13 


162 


31 


125 


24 


99 


19 


76 


14 


6 


1 


WITK022 


92 


16 


206 


39 


151 


29 


47 


9 


26 


5 


11 


2 


W1TH023 


112 


21 


217 


4 1 


139 


26 


40 


6 


20 


4 


7 


1 
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ERIC 



I 



School 



U.th.m.t.cs Assessn-*nt Quest .onn«. re : * Survey of Thouflhts and Feellnfls. for Student, In Qr.d.s 7-9 ^^^^ ^^^^ 

TOTAL (Grado 9) Paae 5 

Qrad* Nina (N-S3S) 



Ques t i on 
Id 



Very 
T ru« 


Sort 
Of 

T ua True 


Not 
Ve ry 
T rua 


Not At 
At 1 
T rue 


Mi ssina 


N % 


N ^ N % 


N % 


N % 


N % 



^RKINQ WITH OTHERS 
Othar Thoughts and Fael i 



WITH0?4 
WITH026 

wiTHOae 

WITH027 
Wl TH028 
Wt THO20 
W) THO30 
Wl TH031 
Wl TH032 
WtTH033 
TH034 
WtTH035 
WITH03d 
Wl TH037 
V^1TH036 
Wl THO30 

w;thO40 

Wl 7H04 1 
W1TH042 
Wl TH043 
Wl TH044 
Wl TH045 
Wl TH04d 
Wl TH047 
W1TH048 
W1TH049 
WITHO50 
Wl TH051 
Wl TH052 
Wl TH053 



114 
27 
43 
23 
36 
106 
118 
lot 
G5 
134 
70 
16 
77 
14 
o 

^6 
41 

66 
21 
66 
57 
35 
25 
30 
102 
o4 
49 
31 
59 
79 



21 176 

5 51 

6 126 
4 42 

7 70 
20 206 

22 176 
19 167 
10 99 
25 167 
13 122 

3 46 

15 102 

3 26 

17 200 

19 157 

6 52 



13 
4 

13 
11 
7 
5 



75 
45 
64 

90 
62 

^) 



6 56 

19 199 

6 67 

9 99 

6 44 

1 1 93 

15 109 



nori 
33 
10 
24 
6 

13 
39 
34 
31 
19 
31 
23 
9 
19 
5 
36 
30 
10 
14 
9 
12 
17 
12 
10 
1 1 
36 
16 
19 
6 
16 
21 



140 

04 

166 
71 
156 
137 
120 
147 
176 
1^5 
166 

66 
152 

45 
140 
143 
106 
160 
1 1 1 
13 1 
153 
179 

67 

63 
153 
139 
164 
101 
193 
117 



26 63 
1C 166 
31 122 
13 156 
30 127 



26 
23 
26 



49 

70 
60 



12 40 
32 167 

23 68 
29 236 

24 134 
9 30 



33 137 
25 56 
32 115 
16 211 

29 112 
6 145 

27 49 
27 62 

20 172 

30 115 

21 170 

25 126 
29 135 

34 154 
13 167 
16 155 
29 47 

26 164 

31 130 
19 142 
37 110 



13 
15 
26 
11 
22 



42 

37 
65 
39 
57 



40 170 

21 66 
27 296 

9 42 
16 49 
33 156 

22 110 
32 179 

24 135 

25 95 
29 99 
35 195 
29 200 

9 25 



31 
25 



106 
86 



2 7 211 
21 69 



22 121 23 104 



6 
36 
13 
45 
26 

6 

6 

7 
12 

7 
1 1 
32 
16 
56 

6 

9 
29 
21 
34 
26 
16 
19 
37 
36 

5 
20 
16 
40 
13 
20 



2 
10 
6 
5 
10 
7 
7 
3 
3 
4 
3 
4 
6 
5 
13 
6 
6 
9 
9 
9 
5 
6 
7 
9 
9 
5 
7 
6 
1 1 
5 



4 2-3 ^ < ^ 

/weak /week /Weex /Week Never Uissinq 

Quos 1 1 on 'J! " 

Id N%N%N%N%N%N% 



WORKING IN A GROUP 

INGRP 35 7 76 \^ 55 10 170 32 191 36 6 1 
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School 



Miithtmatics Assessment Questionnaire: 

TOTAL (Grade 9) 

Grade Nine (N«535) 



A Survey of Thouuhts and FeeMnas. for Students 



in Grades 7-9 



Quest Ion 



Very 
True 

N 



Sort 
Of 



Not 
Very 



Not At 
At I 
T rue 



N 



Before Bealnnma 
HOtfEWKI 144 27 175 

H0UEWK2 79 
HOMEWKS 160 
Whi !• Workina 
H0MEWK4 246 
H0MEMK5 197 
H0MEWK6 169 
After worklno ^ 
H0MEWK7 103 19 151 

H0UEWK6 132 25 190 

H0UEWK9 61 11 103 



15 121 
30 206 

46 205 
37 233 
36 214 



33 109 
23 96 
39 109 



39 
44 
41 



66 
66 
62 



26 121 
36 127 
19 136 



% 


N 


% 


N 


% 


21 


57 


11 


46 


9 


16 


117 


22 


116 


22 


21 


34 


6 


20 


4 


12 


11 


2 


4 


1 


13 


16 


3 


14 


3 


16 


24 


S 


17 


3 


23 


94 


16 


63 


12 


24 


42 


6 


39 




26 


126 


24 


102 


19 



Fa! I 
Paae 



1986 
6 



Missina 



i 
6 
4 

3 
5 
9 

3 
5 
3 



1 
1 
1 

1 
1 
2 

1 
1 
1 
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Mathematics Asse^mant Questionnaire: * Survey of Thouohts and Feet.nos, for Students in Grades 7-9 

TOTAL (Grade 9) 

Grade N-ne (N»635) 



Fall 19d8 
Paae 7 



Very 
True 



Sort 
Of 

True True 



Not Not ki 
Very Al 
True True 



Mi ss i HQ 



Quest i on 
id 



N 



HOMEWORK 

Other ThouQhts a 

HOMEWK10 29 

H0UEWK11 26 

H0MEWK12 52 

H0MEWK13 26 

HOUEWK14 155 

H0«£EWK15 74 

HOUEWK16 23 

H0UEWK17 129 

HCMEWKIft 52 

H0ME«VK19 4 4 

HOME)MK20 101 

HOHEWK21 32 

HOil£WK22 136 

HOIIEWK23 62 

HOMEWK24 26 

HOMEWK2b 100 

HOUE!!VK26 106 

HOUEWK27 45 

HOMEWK28 4 7 

KOUEWK29 105 

HOMEWK30 34 

H0UEWK31 65 

HOUEWK32 58 

HOUEWK33 75 

HOMEWK34 116 

HOMEWK35 32 

H0ilEWK3' 171 

HOUEWK3/ 97 

HOMEWK36 23 

hOMEWK39 45 



5 
5 

10 
5 

29 



29 



54 
54 
47 

99 

14 106 

4 36 
24 212 

10 67 
6 00 

19 12 

6 30 
26 162 
16 117 

5 40 

19 173 

20 150 
9 65 
9 66 

20 141 

6 67 
16 113 

11 113 
14 96 
22 65 

6 36 
32 175 
19 142 
4 31 
9 55 



% 


N 


% 


N 


% 


N 


% 


N 


5 


83 


16 


178 


33 


2t4 


40 


2 


1 0 


150 


28 


157 


30 


141 


27 


5 


1 n 


126 


24 


• 31 


25 


156 


30 


12 


q 

9 


96 


19 


179 


34 


177 


34 


6 


1 Q 


110 


2 1 


85 


16 


63 


16 


3 


7 ft 


1 43 


27 


124 


23 


81 


15 


5 


7 


61 


12 


166 


31 


243 


46 


6 


40 


123 


24 


35 


7 


25 


5 


6 


1 3 


1 43 


27 


1 4 


22 


150 


29 


9 




126 


24 


1 40 


26 


161 


30 


4 




176 


34 


64 


16 


43 


6 


10 


5 


69 


17 


191 


36 


169 


36 


4 


3 1 


163 


31 


45 


6 


25 


5 


4 


22 


142 


27 


112 


21 


76 


14 


6 


6 


65 


16 


174 


33 


205 


39 


5 


33 


156 


30 


60 


1 1 


37 


7 


7 


26 


131 


25 


65 


16 


54 


10 


7 


12 


141 


27 


175 


33 


100 


19 


9 


16 


160 


30 


123 


23 


110 


21 


9 


27 


136 


26 


61 


16 


56 


1 1 


16 


13 


167 


32 


149 


26 


110 


21 


6 


21 


156 


30 


107 


20 


67 


13 


7 


21 


166 


35 


96 


19 


71 


13 


9 


19 


143 


27 


100 


19 


112 


21 


7 


16 


152 


29 


101 


19 


72 


14 


7 


7 


99 


19 


166 


32 


196 


37 


2 


33 


95 


16 


50 


0 


38 


7 


6 


27 


193 


37 


73 


14 


19 


4 


11 


6 


52 


10 


162 


31 


263 


50 


4 


10 


104 


20 


159 


30 


166 


31 


6 
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Appendix 5-1 

Statement Numbers, Scale Response Numbers for Indicators, and 
Interpretation of Diagnostic Indicators for Affective Belief, 
Motivation and Attribution Categories 



Activity Setting 



Thought's 
& Feelings 



During 
Class 



Working 
W/Others 



Homework Interpretation 



Value 



26(R) 

28 

34 



32 
44 

46(R) 



12 (R) 
20 

39 (R, 



4 or 5 
indicates 
low value 



Interest 



24 

44 (R) 
49 



30 
36 

40(R) 



18 
28 

34 (R) 



4 or 5 
indicates 
low interest 



Confidence 



20 

31(R) 
48(R) 



24 

27 (R) 
48 



13 (R) 
22 

35 (R) 



4 or 5 

indicates 

low confidence 



Anxi ty 



27 

35(R) 
39 



25 

31 (R) 
51 



19 

26 (R) 
36 (R) 



1 or 2 
indicates 
high anxiety 



Internal 
Learning 
Goals 



30 
32 
42 



29 
33 



x5 
23 
31 



4 or 5 

indicates not 
inter, motivated 



External 25 
Performance 36 
Goals 40 



37 
43 
53 



14 
29 
33 



1 or 2 
indicates 
exter. motivated 



Internal 22 
Stable 37 
Uncontrollable 41 



26 
38 
52 



10 
16 
38 



1 or 2 

indicates internal 
stable uncontroi 



Internal 43 
Stable 45 
Controllable 47 



34 
41 

49 



17 
25 
37 



4 or 5 

indicates internal 
=!table uncontroi 
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IBS 



Appendix (continued) 



External 23 
Stable 29 
Uncontrollable 46 



35 
45 
50 



21 
27 
32 



1 or 2 

indicates axtexnal 
stable uncontrol. 



Unknown 
Control 



21 
33 
38 



28 
42 
47 



11 
24 

30 



1 or 2 

indicates unknown 
sense of control. 



■^Where an (R) appears, the opposite end of a scale, the reverse is 
counted: e.g., for confidence a or 5 indicates low confidence and 
the (R) next to 31 indicates that the reverse end, a 1 or 2 is counted 51 
as an indicator of low confidence. 
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